-- Logs begin at Wed 2022-05-25 14:23:22 UTC, end at Wed 2022-05-25 15:27:07 UTC. -- May 25 14:59:19.852981 dv-osbrick-830800-16-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 25 14:59:19.861155 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 14:59:19.863727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 14:59:19 2022] *** May 25 14:59:19.863866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 14:59:19.863984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 14:59:19.864083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: nodename: dv-osbrick-830800-16-iscsi May 25 14:59:19.864184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: machine: x86_64 May 25 14:59:19.864286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: clock source: unix May 25 14:59:19.864382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: pcre jit disabled May 25 14:59:19.864480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: detected number of CPU cores: 4 May 25 14:59:19.864577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: current working directory: / May 25 14:59:19.864681 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: detected binary path: /usr/bin/uwsgi-core May 25 14:59:19.864785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: your processes number limit is 47680 May 25 14:59:19.864886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: your memory page size is 4096 bytes May 25 14:59:19.864986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: detected max file descriptor number: 2048 May 25 14:59:19.865091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: lock engine: pthread robust mutexes May 25 14:59:19.865406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: thunder lock: enabled May 25 14:59:19.865590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 14:59:19.865671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 14:59:19.909642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: Python main interpreter initialized at 0x5608cca0f9c0 May 25 14:59:19.909642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: python threads support enabled May 25 14:59:19.909642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: your server socket listen backlog is limited to 100 connections May 25 14:59:19.909642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: your mercy for graceful operations on workers is 90 seconds May 25 14:59:19.909985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: mapped 403077 bytes (393 KB) for 2 cores May 25 14:59:19.910059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: *** Operational MODE: preforking *** May 25 14:59:19.910335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: *** uWSGI is running in multiple interpreter mode *** May 25 14:59:19.910335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: spawned uWSGI master process (pid: 80314) May 25 14:59:19.910541 dv-osbrick-830800-16-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 25 14:59:19.911427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: spawned uWSGI worker 1 (pid: 80325, cores: 1) May 25 14:59:19.911427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: spawned uWSGI worker 2 (pid: 80326, cores: 1) May 25 14:59:19.911615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80314]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 14:59:25.471109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:59:25.471109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: from cryptography.utils import int_from_bytes May 25 14:59:25.471843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:59:25.471843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: from cryptography.utils import int_from_bytes May 25 14:59:25.496122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:59:25.496122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: from cryptography.utils import int_from_bytes May 25 14:59:25.496653 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:59:25.496653 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: from cryptography.utils import int_from_bytes May 25 14:59:25.520842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:59:25.520998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:59:25.521224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] command line args: [] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:59:25.521641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:59:25.521761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ================================================================================ {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:59:25.521972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] admin_token = **** {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.522209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] config_dir = [] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.522375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.522590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] config_source = [] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.522722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] debug = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.522975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.523327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.523508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.523788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.524037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.524365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] list_limit = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.524466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] log_config_append = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.524594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.524770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] log_dir = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.524973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] log_file = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.525173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.525422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.525668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.525931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.526093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.526276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.526528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.526772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.527004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.527235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.527466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.527731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.527976 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.528222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.528499 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.528981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.529163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] publish_errors = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.529391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.529618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.529796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.530042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.530277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.530509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] standard_threads = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.530737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.530978 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.531154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.531330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] use_journal = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.531505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] use_json = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.531704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] use_stderr = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.531879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] use_syslog = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.532108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.532366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.532606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.532864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.533104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.533353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.533592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.533840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.534077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.534325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.534572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.534824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.535058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.535303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.535539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.535807 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.536054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.536293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.536552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.537776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.538029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.538270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.538529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.538797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.539053 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.539305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.539591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.539817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.540052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.540288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.540854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.541103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.541334 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.541563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.541811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.542060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.542300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.542549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.542781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.543017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.543251 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.543481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.543733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.543963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.544199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.544433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.544681 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.544826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:59:25.544908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.545021 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:59:25.545133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.545222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] command line args: [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:59:25.545361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.545477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:59:25.545595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.545679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ================================================================================ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:59:25.545827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.545914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] admin_token = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.546074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.546153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] config_dir = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.546303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.546380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.546486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] config_source = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.546580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.546655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] debug = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.546758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.546857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.546991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.547144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.547226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.547298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.547453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.547537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.547703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.547796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.547952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.548031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.548137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_config_append = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.548215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.548298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.548409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.548490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_dir = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.548639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.548726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_file = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.548880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.548964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.549121 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.549200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.549350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.549428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.549585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.549664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.549751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.549830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.549930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.550074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.550174 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.550312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.550418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.550558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.550637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.550803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.550887 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.551038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.551118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.551284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.551370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.551520 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.551628 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.551782 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.551859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.552015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.552094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.552252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.552495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.552580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.552699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] publish_errors = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.552777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.552984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.553076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.553202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.553278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.553375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.553454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.553619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.553707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.553844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.553931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.554072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] standard_threads = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.554151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.554300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.554391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.554542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.554621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.554729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.554833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.554930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] use_journal = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.555033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] use_json = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.555128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.555222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] use_stderr = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.555316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.555426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] use_syslog = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.555524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.555672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:59:25.555780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.555866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.555989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.556065 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.556180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.556321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.556404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.556562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.556643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.556811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.556892 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.557052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.557202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.557287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.557367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.557526 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.557618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.557774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.557853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.558023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.558105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.558265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.558356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.558497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] auth.external = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.558573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.558728 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.558805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.558963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.559054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.559212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.559294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.559458 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.559542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] auth.password = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.559711 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] auth.token = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.559790 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.559952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.560049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.560188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.560274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.560433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.560512 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.560666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.560749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.560912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.560992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.561158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.561237 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.561388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.561468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.561622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] credential.caching = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.561708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.561867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.561945 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.562107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.562188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.562338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.562417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.562573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.562658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.562812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.562892 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.563045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.563124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.563274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.563350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.563504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.563616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.563787 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.563867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.564037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.564116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.564264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.564340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.564512 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.564592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.564743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.564822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.564981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.565069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.565215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.565294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.565445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.565524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] federation.caching = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.565675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.565756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.565906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.565985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.566148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.566234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.566386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.566480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.566633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.566714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.566863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.566948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.567100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.567191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.567330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.567409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.567608 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.567702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.567820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.567909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.568066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.568144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.568294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.568371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.caching = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.568555 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.568643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.568791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.568872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.569023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.569106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.569256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.569343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.569501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.569580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.569731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.569817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.569969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.570056 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.570205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.570297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.570442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.570521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.570673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.570761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.570938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.571026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.571173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.571254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.571403 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.571489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.571664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.571806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.571888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.572087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.572174 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.572383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.572481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.572632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.572713 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.572877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.572962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.573122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.573203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.573351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.573437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.573580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.573667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.573818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.573897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.574049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.574131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.574282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.574361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.574523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.574600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.574757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.574837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.574994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.575073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.575222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.575309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.575455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.575535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.575715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.575798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.575953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.576032 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.576198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.576280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.576436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.576515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.576663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.576742 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.576900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.576981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.577135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.577215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.577371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.577453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.577602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.577678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.577824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.577903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.578053 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.578140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.578282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.578364 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.578516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.578597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.578744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.578833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.578980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.579060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.579210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.579289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.579454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.579538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.579722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.579804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.579956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.580037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.580191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.580271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.580426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.580508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.580656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.580736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.external = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.580894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.580974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.581152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.581234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.581381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.581460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.581626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.581714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.password = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.581857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] auth.token = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.581936 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.582096 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.582175 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.582333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.582420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.582559 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.582638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.582794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.582874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.583027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.583119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.583262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.583350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.583490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.583587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.583753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.583910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.583985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.584047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.584281 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.584377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.584525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.584616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.584762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.584843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.584990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.585069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.585228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.585316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.585464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.585551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.585702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.585782 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.585938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.586028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.586174 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.586254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.586420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.586513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.586668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.586757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.586904 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.586986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.587162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.587243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.587393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.587481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.587657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.587743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.587896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.587976 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.588130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.588226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.588366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.588448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.588595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.588673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.588840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.588927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.589077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.589156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.589314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.589393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.589558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.589644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] resource.caching = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.589805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.589883 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.590040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.590125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.590277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.590364 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.590509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.590628 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.590760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.590840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.590993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.591081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.591275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.591425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.591584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.591715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.591845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.591997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.592127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] role.caching = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.592256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.592256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.592496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] role.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.592496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.592751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.592878 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.593003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.593129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.593260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.593260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.593507 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.593633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.593771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.593898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.594024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.594162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.594289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.594417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.594544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.594671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.594799 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.594934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.595063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.595191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.595320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.595458 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.595608 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.595750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.595879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.596008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.596134 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.596262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.596262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.596511 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.596638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.596765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.596892 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.597016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.597154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.597288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.597415 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.597543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.597670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.597797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.597924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.598060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.598187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.598315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.598442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.598570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.598700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.598836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.598972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.599098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.599225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.599353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.599480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.599664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.599791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.599920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.600048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.600174 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.600301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.600437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.600564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.600703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.600830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.600957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.601084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.601283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.601412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.601540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] token.caching = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.601668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.601795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.601924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.602057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.602186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.602312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.602439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.602575 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.602704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.602840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.602967 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.603094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.603219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.603344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.603477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.603620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.603745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.603874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.604001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.604127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.604264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.604401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.604529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.604655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.604780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.604907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.605042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.605169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.605299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.605425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.605552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.605680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.605815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.605942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.606078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.606078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.606317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.connection = **** {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.606451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.606584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.606584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.606834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.606963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.607091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.607218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.607345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.607472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.607624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.607751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.607892 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.608022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.608150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.608277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.608413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.608540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.608667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.608793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.608920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.609047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.609183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.609309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.609436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.609561 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.609949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.610081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.610217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.610344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.610471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.610603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.610731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.610855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.610988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.611116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.611116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80325) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:59:25.611356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.611356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.611356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.611356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.611356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.611356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.611356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.611356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.611356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.612407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.612407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.612407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.612407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.612407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.612407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.612407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.613203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.613203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.613203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.613203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] role.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.613661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] role.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.613661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.613894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.614103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.614350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.614594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.614840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.615085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.615331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.615709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.615947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.616194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.616441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.616687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.616934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.617327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.617565 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.617816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.618069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.618320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.618569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.618804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.619058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.619310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.619548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.619804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.620042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.620273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.620522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.620775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.621022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.621256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.621491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.621721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.621955 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.622190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.622436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.622671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.622926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.623172 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.623408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.623688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.623934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.624179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.624413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.624651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.624894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.625139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.625385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.625614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.625856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.626151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.626414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.626660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.626906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.627144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.627383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.627640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.627889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.628124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.628361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.628605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.628840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.629082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.629316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.629560 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.629799 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.630042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.630271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.630510 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.630743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:59:25.630912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:59:25.639326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.639558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.639805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.648317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.655536 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.655793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.656019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.666330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.676678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.676916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.684596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.684826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.728949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.729825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.779765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.779975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.780264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.780498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.844564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.844720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.844799 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.844863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.845073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.845260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.845358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.845503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.845631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.845813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.845906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.846031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.868592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.868724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.868948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.869040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.869192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.869342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.869428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.869561 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.869647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.869770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.869854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.869976 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.870061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.870192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.881087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.881219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.893806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.893948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.894213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.894306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.894440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.894524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.894648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.894744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.894871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.894998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.895080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.895214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.895299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80326) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.895429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80325) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:59:25.912093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.912230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.912382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:59:25.912516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:59:25.912665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.913140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.913270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:59:25.913397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:59:25.913539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.913665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.913841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.913968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.914098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.914227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.914357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.914495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.925322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.925596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.925841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.926136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.926847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.927124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.927390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.927688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.934295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:25.935802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:25.937598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:25.937879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.938163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.938442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.938723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.938984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.939111 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:25.939381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.939507 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.939715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.939823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.939954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.940120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.940120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.940370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.940502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.940641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.940771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.941031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.941300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.941571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.941836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.966882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.968558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.968687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:25.968950 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.970320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:25.970608 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.974274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:25.974552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.974838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.975939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:25.976215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.976494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.982395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:25.982620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.983780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:25.984064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.987174 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:25.987606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.987886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.988167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.988449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.988575 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:25.988775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.988903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.989046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.989189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.989329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.989458 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.989726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.990001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.990272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:25.990543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.008046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.008316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.009137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.009416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.013011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.014040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.016660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.016955 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.017641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.017934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.022027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.023160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.025697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.026804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.029489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.029794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.030079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.030366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.030596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.030724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.030893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.030962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.031165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.031445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.031753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.032039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.050273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.050559 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.050823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.051086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.051307 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.051599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.051877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.052137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.059108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.060164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.060840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.061116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.061846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.062126 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.064181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.064457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.064741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.065036 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.065164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.065304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.065401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.065712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.065993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.066265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.078998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.079274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.079589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.079862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.079988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.080119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.080219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.080387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.080482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.080687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.080813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.080967 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.081237 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.081511 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.098669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.099476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.101999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.102827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.105331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.106157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.106928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.107783 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.108603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.108891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.109172 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.109369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.109672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.109963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.116634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.117375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.118246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.118989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.121691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.121989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.122274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.122500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.122631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.122802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.123170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.123500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.131687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.131972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.132404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.132678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.132963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.133343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.140298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80325) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.140576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.140853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.141123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.141251 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80326) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:59:26.141380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.141467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.141688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.141905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.141998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.142066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.142188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.142280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.142477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.142606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.142745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.142843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.143015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.143102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.143250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.143378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.143490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.143625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.143810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80325) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.143942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.144066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.144352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.144618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80326) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:59:26.182855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5608cca0f9c0 pid: 80325 (default app) May 25 14:59:26.183513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5608cca0f9c0 pid: 80326 (default app) May 25 14:59:26.186122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff816-2349-41f0-8842-f7423b2b4bf7 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:26.186413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff816-2349-41f0-8842-f7423b2b4bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:26.186690 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff816-2349-41f0-8842-f7423b2b4bf7 None None] PATH_INFO: `/v3` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:26.191039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 791 bytes} [Wed May 25 14:59:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:34.153369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544b575-434d-4166-b94a-c44f00eb8c87 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:34.154277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544b575-434d-4166-b94a-c44f00eb8c87 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:34.154277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544b575-434d-4166-b94a-c44f00eb8c87 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:34.161664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 1/2] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:34 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:34.170139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5df3-f1cf-410d-b459-22a2fc2fc5d6 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:34.170862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5df3-f1cf-410d-b459-22a2fc2fc5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:34.171070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5df3-f1cf-410d-b459-22a2fc2fc5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:34.242743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: INFO dbcounter [None req-41ad5df3-f1cf-410d-b459-22a2fc2fc5d6 None None] Registered counter for database keystone May 25 14:59:34.267423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG oslo_db.sqlalchemy.engines [None req-41ad5df3-f1cf-410d-b459-22a2fc2fc5d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80325) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:59:34.275543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writer thread running {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:59:34.455451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG passlib.handlers.bcrypt [None req-41ad5df3-f1cf-410d-b459-22a2fc2fc5d6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80325) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 14:59:34.455916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG passlib.handlers.bcrypt [None req-41ad5df3-f1cf-410d-b459-22a2fc2fc5d6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80325) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 14:59:34.512988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-41ad5df3-f1cf-410d-b459-22a2fc2fc5d6 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:34.514612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-41ad5df3-f1cf-410d-b459-22a2fc2fc5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:34.645358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 2/3] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 14:59:34.836715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544b575-434d-4166-b94a-c44f00eb8c87 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:34.912168 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: INFO dbcounter [None req-d544b575-434d-4166-b94a-c44f00eb8c87 None None] Registered counter for database keystone May 25 14:59:34.933829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG oslo_db.sqlalchemy.engines [None req-d544b575-434d-4166-b94a-c44f00eb8c87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:59:34.942637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writer thread running {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:59:35.069372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544b575-434d-4166-b94a-c44f00eb8c87 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:35.074824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce58e4-588f-4d2d-85eb-fe345592cf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:35.075507 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce58e4-588f-4d2d-85eb-fe345592cf09 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:35.075826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce58e4-588f-4d2d-85eb-fe345592cf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:35.076105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce58e4-588f-4d2d-85eb-fe345592cf09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:35.085437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce58e4-588f-4d2d-85eb-fe345592cf09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:35.136637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: WARNING keystone.common.rbac_enforcer.enforcer [None req-10ce58e4-588f-4d2d-85eb-fe345592cf09 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 14:59:35.136910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce58e4-588f-4d2d-85eb-fe345592cf09 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:35.147424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 2/4] 10.222.0.24 () {58 vars in 1324 bytes} [Wed May 25 14:59:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:59:35.154417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad5df3-f1cf-410d-b459-22a2fc2fc5d6 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:35.169710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad5df3-f1cf-410d-b459-22a2fc2fc5d6 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:35.175360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f4ce1-27cf-412b-94e3-b2c8f8f7210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:35.176534 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f4ce1-27cf-412b-94e3-b2c8f8f7210f admin admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:35.176823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f4ce1-27cf-412b-94e3-b2c8f8f7210f admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:35.177109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f4ce1-27cf-412b-94e3-b2c8f8f7210f admin admin] PATH_INFO: `/v3/projects/94e02961c51b473ebdfc8f91d292091e` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:35.178758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f4ce1-27cf-412b-94e3-b2c8f8f7210f admin admin] RBAC: Authorizing `identity:get_project(project_id=94e02961c51b473ebdfc8f91d292091e)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:35.339527 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: WARNING keystone.common.rbac_enforcer.enforcer [None req-489f4ce1-27cf-412b-94e3-b2c8f8f7210f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 14:59:35.339900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f4ce1-27cf-412b-94e3-b2c8f8f7210f admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:35.344667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 3/5] 10.222.0.24 () {56 vars in 1207 bytes} [Wed May 25 14:59:35 2022] GET /identity/v3/projects/94e02961c51b473ebdfc8f91d292091e => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:59:37.519090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b25c34-12e9-4481-90ed-c77c3e03549d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:37.519932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b25c34-12e9-4481-90ed-c77c3e03549d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:37.520105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b25c34-12e9-4481-90ed-c77c3e03549d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:37.527914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 3/6] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:37.536889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30c3d-aaed-46b5-824c-1f0a01cc340e None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:37.537613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30c3d-aaed-46b5-824c-1f0a01cc340e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:37.537769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30c3d-aaed-46b5-824c-1f0a01cc340e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:37.560745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-6ae30c3d-aaed-46b5-824c-1f0a01cc340e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:37.562326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-6ae30c3d-aaed-46b5-824c-1f0a01cc340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:37.571903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 4/7] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 14:59:37.594316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b25c34-12e9-4481-90ed-c77c3e03549d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:37.608717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b25c34-12e9-4481-90ed-c77c3e03549d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:37.613886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569de91-dd19-4a20-9177-53bcc7955e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:37.614524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569de91-dd19-4a20-9177-53bcc7955e1c admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:37.614795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569de91-dd19-4a20-9177-53bcc7955e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:37.615080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569de91-dd19-4a20-9177-53bcc7955e1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:37.623184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569de91-dd19-4a20-9177-53bcc7955e1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:37.624993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569de91-dd19-4a20-9177-53bcc7955e1c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:37.638516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 4/8] 10.222.0.24 () {58 vars in 1324 bytes} [Wed May 25 14:59:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:59:37.647397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30c3d-aaed-46b5-824c-1f0a01cc340e None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:37.662313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30c3d-aaed-46b5-824c-1f0a01cc340e None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:37.671289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1381c-5115-484f-a6df-82248e02b5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:37.672202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1381c-5115-484f-a6df-82248e02b5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:37.672489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1381c-5115-484f-a6df-82248e02b5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:37.672766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1381c-5115-484f-a6df-82248e02b5b7 admin admin] PATH_INFO: `/v3/users/ad3666eef9be46b0b4707636932d0a11` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:37.674327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1381c-5115-484f-a6df-82248e02b5b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=ad3666eef9be46b0b4707636932d0a11)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:37.676234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1381c-5115-484f-a6df-82248e02b5b7 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:37.677819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 5/9] 10.222.0.24 () {56 vars in 1198 bytes} [Wed May 25 14:59:37 2022] GET /identity/v3/users/ad3666eef9be46b0b4707636932d0a11 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:39.917712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf538371-4778-4d04-8085-caac0aefef56 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:39.918260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf538371-4778-4d04-8085-caac0aefef56 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:39.918260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf538371-4778-4d04-8085-caac0aefef56 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:39.919662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 5/10] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:39.925157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f0d51-7226-4047-9563-caee92156583 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:39.925582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f0d51-7226-4047-9563-caee92156583 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:39.925680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f0d51-7226-4047-9563-caee92156583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:39.943000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-e79f0d51-7226-4047-9563-caee92156583 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:39.944527 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-e79f0d51-7226-4047-9563-caee92156583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:39.980019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf380f57-4338-4b28-988f-3c389c0f0863 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:39.980349 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf380f57-4338-4b28-988f-3c389c0f0863 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:39.980623 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf380f57-4338-4b28-988f-3c389c0f0863 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:39.981999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 6/11] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:39.987293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda281a0-f371-44fc-97e3-3d018ed32e7e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:39.987605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda281a0-f371-44fc-97e3-3d018ed32e7e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:39.987889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda281a0-f371-44fc-97e3-3d018ed32e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:40.027994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 6/12] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:59:40.028209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG passlib.handlers.bcrypt [None req-dda281a0-f371-44fc-97e3-3d018ed32e7e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80326) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 14:59:40.028408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG passlib.handlers.bcrypt [None req-dda281a0-f371-44fc-97e3-3d018ed32e7e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80326) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 14:59:40.051189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f0d51-7226-4047-9563-caee92156583 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:40.074964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-dda281a0-f371-44fc-97e3-3d018ed32e7e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:40.075951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:40.076598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dda281a0-f371-44fc-97e3-3d018ed32e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:40.163417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f0d51-7226-4047-9563-caee92156583 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:40.183905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 7/13] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:59:40.198703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c432299-8a5a-4d46-9fdb-ed885094701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:40.199519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c432299-8a5a-4d46-9fdb-ed885094701a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:40.199841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c432299-8a5a-4d46-9fdb-ed885094701a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:40.200127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c432299-8a5a-4d46-9fdb-ed885094701a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:40.205578 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda281a0-f371-44fc-97e3-3d018ed32e7e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:40.212323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c432299-8a5a-4d46-9fdb-ed885094701a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-8c432299-8a5a-4d46-9fdb-ed885094701a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:59:40.223691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:59:40.224855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 14:59:40.225908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 7/14] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 14:59:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:59:40.230996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c432299-8a5a-4d46-9fdb-ed885094701a None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:40.308431 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda281a0-f371-44fc-97e3-3d018ed32e7e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:40.310674 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:40.311193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:40.330519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c432299-8a5a-4d46-9fdb-ed885094701a None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:40.345453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f204ca7-262e-4ee8-9f82-e8a2b1f65e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:40.346377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f204ca7-262e-4ee8-9f82-e8a2b1f65e31 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:40.346755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f204ca7-262e-4ee8-9f82-e8a2b1f65e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:40.347040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f204ca7-262e-4ee8-9f82-e8a2b1f65e31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:40.363004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bd0b2-1df4-4da5-8749-6f17b0582163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:40.363698 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bd0b2-1df4-4da5-8749-6f17b0582163 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:40.363982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bd0b2-1df4-4da5-8749-6f17b0582163 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:40.364258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bd0b2-1df4-4da5-8749-6f17b0582163 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:40.365029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bd0b2-1df4-4da5-8749-6f17b0582163 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:40.365336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bd0b2-1df4-4da5-8749-6f17b0582163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:40.366752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bd0b2-1df4-4da5-8749-6f17b0582163 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:40.378517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 8/15] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 14:59:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:40.384344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bd0b2-1df4-4da5-8749-6f17b0582163 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:40.416309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f204ca7-262e-4ee8-9f82-e8a2b1f65e31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:40.417848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f204ca7-262e-4ee8-9f82-e8a2b1f65e31 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:40.489418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bd0b2-1df4-4da5-8749-6f17b0582163 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:40.519366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 8/16] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 14:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:59:40.525140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f204ca7-262e-4ee8-9f82-e8a2b1f65e31 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:40.527258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e27d8b-b65c-493e-aecf-5744b4f9cb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:40.528125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:40.528233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e27d8b-b65c-493e-aecf-5744b4f9cb73 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:40.528440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e27d8b-b65c-493e-aecf-5744b4f9cb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:40.528727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e27d8b-b65c-493e-aecf-5744b4f9cb73 None admin] PATH_INFO: `/v3/users/ad3666eef9be46b0b4707636932d0a11` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:40.530136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e27d8b-b65c-493e-aecf-5744b4f9cb73 None admin] RBAC: Authorizing `identity:get_user(user_id=ad3666eef9be46b0b4707636932d0a11)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:40.531652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e27d8b-b65c-493e-aecf-5744b4f9cb73 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:40.533421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 9/17] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 14:59:40 2022] GET /identity/v3/users/ad3666eef9be46b0b4707636932d0a11 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:59:40.538687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e27d8b-b65c-493e-aecf-5744b4f9cb73 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:40.553567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:40.624207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f204ca7-262e-4ee8-9f82-e8a2b1f65e31 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:40.636063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e27d8b-b65c-493e-aecf-5744b4f9cb73 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:40.658241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066edfe-9d4a-4d34-adee-b2e47f48bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:40.659057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066edfe-9d4a-4d34-adee-b2e47f48bba2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:40.659347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066edfe-9d4a-4d34-adee-b2e47f48bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:40.659976 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066edfe-9d4a-4d34-adee-b2e47f48bba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:40.669196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53c278-aa8e-412a-b13d-90b067f19bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:40.669997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53c278-aa8e-412a-b13d-90b067f19bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:40.670286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53c278-aa8e-412a-b13d-90b067f19bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:40.670566 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53c278-aa8e-412a-b13d-90b067f19bd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:40.671783 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53c278-aa8e-412a-b13d-90b067f19bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:40.673247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53c278-aa8e-412a-b13d-90b067f19bd0 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:40.674864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 10/18] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 14:59:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:40.678842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066edfe-9d4a-4d34-adee-b2e47f48bba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:40.680347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066edfe-9d4a-4d34-adee-b2e47f48bba2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:40.680568 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53c278-aa8e-412a-b13d-90b067f19bd0 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-f066edfe-9d4a-4d34-adee-b2e47f48bba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:59:40.701802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:59:40.702702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 14:59:40.703506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:59:40.703506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:59:40.703506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:59:40.703506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 14:59:40.703506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 9/19] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 14:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:59:40.709101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066edfe-9d4a-4d34-adee-b2e47f48bba2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:40.760264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:40.765328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:40.780052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53c278-aa8e-412a-b13d-90b067f19bd0 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:40.808093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066edfe-9d4a-4d34-adee-b2e47f48bba2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:40.814122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32160c5f-e6ab-4776-8585-79a4cb790398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:40.814789 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32160c5f-e6ab-4776-8585-79a4cb790398 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:40.815075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32160c5f-e6ab-4776-8585-79a4cb790398 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:40.815351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32160c5f-e6ab-4776-8585-79a4cb790398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:40.816263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32160c5f-e6ab-4776-8585-79a4cb790398 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.domain.id=default, user.id=ad3666eef9be46b0b4707636932d0a11) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:40.816582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32160c5f-e6ab-4776-8585-79a4cb790398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:40.818055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32160c5f-e6ab-4776-8585-79a4cb790398 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:40.824995 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 11/20] 10.222.0.24 () {56 vars in 1322 bytes} [Wed May 25 14:59:40 2022] GET /identity/v3/role_assignments?user.id=ad3666eef9be46b0b4707636932d0a11&scope.domain.id=default&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:59:40.841997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48558d-0218-4214-a260-d07f09871d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:40.842690 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48558d-0218-4214-a260-d07f09871d7c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:40.842976 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48558d-0218-4214-a260-d07f09871d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:40.843253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48558d-0218-4214-a260-d07f09871d7c None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:40.844046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48558d-0218-4214-a260-d07f09871d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:40.844356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48558d-0218-4214-a260-d07f09871d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:40.845811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48558d-0218-4214-a260-d07f09871d7c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:40.866740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 10/21] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 14:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:43.525178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79abf8-bd3e-4146-9848-af67f948d428 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:43.525716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79abf8-bd3e-4146-9848-af67f948d428 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:43.525789 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79abf8-bd3e-4146-9848-af67f948d428 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:43.527266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 12/22] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:43.541738 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116eb78-aa38-4691-8a48-4c2d95bc711b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:43.542248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116eb78-aa38-4691-8a48-4c2d95bc711b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:43.542355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116eb78-aa38-4691-8a48-4c2d95bc711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:43.581258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641bca3-a7ce-4d32-b38e-53a5131d9dcf None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:43.581593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641bca3-a7ce-4d32-b38e-53a5131d9dcf None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:43.581825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641bca3-a7ce-4d32-b38e-53a5131d9dcf None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:43.583383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 13/23] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:43.589166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d070e0-a2ad-4e1e-bbe0-602d7ea247b9 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:43.589461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d070e0-a2ad-4e1e-bbe0-602d7ea247b9 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:43.589737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d070e0-a2ad-4e1e-bbe0-602d7ea247b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:43.628881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-d1d070e0-a2ad-4e1e-bbe0-602d7ea247b9 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:43.630142 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-d1d070e0-a2ad-4e1e-bbe0-602d7ea247b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:43.745559 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8116eb78-aa38-4691-8a48-4c2d95bc711b None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:43.747099 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8116eb78-aa38-4691-8a48-4c2d95bc711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:43.751330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 14/24] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:59:43.752752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087a420-4f0d-4a07-b3d4-1778a76e733f None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:43.753039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087a420-4f0d-4a07-b3d4-1778a76e733f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:43.753326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087a420-4f0d-4a07-b3d4-1778a76e733f None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:43.759972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 15/25] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:43.765420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc7e40-2e9b-4d83-bea6-db447dcaeb19 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:43.765716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc7e40-2e9b-4d83-bea6-db447dcaeb19 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:43.766004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc7e40-2e9b-4d83-bea6-db447dcaeb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:43.795331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-11fc7e40-2e9b-4d83-bea6-db447dcaeb19 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:43.796562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-11fc7e40-2e9b-4d83-bea6-db447dcaeb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:43.854840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 11/26] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:59:43.855729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116eb78-aa38-4691-8a48-4c2d95bc711b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:43.893437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 16/27] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:59:43.903686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc7e40-2e9b-4d83-bea6-db447dcaeb19 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:43.917105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:43.931673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:43.997732 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116eb78-aa38-4691-8a48-4c2d95bc711b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.030865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc7e40-2e9b-4d83-bea6-db447dcaeb19 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.032716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79d734-9410-47f7-9fbc-0342746d3719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.033638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79d734-9410-47f7-9fbc-0342746d3719 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.033935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79d734-9410-47f7-9fbc-0342746d3719 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.034213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79d734-9410-47f7-9fbc-0342746d3719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.046129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79d734-9410-47f7-9fbc-0342746d3719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.047648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79d734-9410-47f7-9fbc-0342746d3719 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3c79d734-9410-47f7-9fbc-0342746d3719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:59:44.066335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:59:44.067176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 14:59:44.068016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:59:44.068016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:59:44.068016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:59:44.068016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 14:59:44.068016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 12/28] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 14:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:59:44.068715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc79b93-227c-4b50-a719-7e04dca7947f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.071586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95073f9d-e732-44cd-b50a-e0ee08cf947c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.071586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95073f9d-e732-44cd-b50a-e0ee08cf947c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.071773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc79b93-227c-4b50-a719-7e04dca7947f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.071841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95073f9d-e732-44cd-b50a-e0ee08cf947c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.071905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc79b93-227c-4b50-a719-7e04dca7947f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.071905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc79b93-227c-4b50-a719-7e04dca7947f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.072035 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 13/29] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:44.075987 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95073f9d-e732-44cd-b50a-e0ee08cf947c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.086964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc79b93-227c-4b50-a719-7e04dca7947f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-0cc79b93-227c-4b50-a719-7e04dca7947f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:59:44.094777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:59:44.096891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 17/30] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 14:59:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:59:44.098055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc79b93-227c-4b50-a719-7e04dca7947f None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.167409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:44.192204 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:44.198113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95073f9d-e732-44cd-b50a-e0ee08cf947c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.211816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc79b93-227c-4b50-a719-7e04dca7947f None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.236855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986f227-57e8-496a-afdf-21bd93e6a0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.237566 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986f227-57e8-496a-afdf-21bd93e6a0a6 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.237927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986f227-57e8-496a-afdf-21bd93e6a0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.238208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986f227-57e8-496a-afdf-21bd93e6a0a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.239090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986f227-57e8-496a-afdf-21bd93e6a0a6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.240513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986f227-57e8-496a-afdf-21bd93e6a0a6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:44.250715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae247a0b-5cac-4a5d-a19b-05dc91871ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.251372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae247a0b-5cac-4a5d-a19b-05dc91871ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.251762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae247a0b-5cac-4a5d-a19b-05dc91871ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.252031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae247a0b-5cac-4a5d-a19b-05dc91871ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.252841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae247a0b-5cac-4a5d-a19b-05dc91871ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:44.253179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae247a0b-5cac-4a5d-a19b-05dc91871ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.254624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae247a0b-5cac-4a5d-a19b-05dc91871ea3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:44.277944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 18/31] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 14:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:44.279356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e5d92-7870-4cef-9501-4a6f86e95d42 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.279672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e5d92-7870-4cef-9501-4a6f86e95d42 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.279957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e5d92-7870-4cef-9501-4a6f86e95d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.297226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-942e5d92-7870-4cef-9501-4a6f86e95d42 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:44.298424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-942e5d92-7870-4cef-9501-4a6f86e95d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:44.370332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 19/32] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:59:44.371185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e5d92-7870-4cef-9501-4a6f86e95d42 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.376912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 14/33] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 14:59:44 2022] POST /identity/v3/roles => generated 225 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:44.378208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986f227-57e8-496a-afdf-21bd93e6a0a6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.471501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:44.522642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e5d92-7870-4cef-9501-4a6f86e95d42 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.572561 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5fc7c-3a8a-45a7-8f3b-746de7e161fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.573378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5fc7c-3a8a-45a7-8f3b-746de7e161fb None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.573665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5fc7c-3a8a-45a7-8f3b-746de7e161fb None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.573947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5fc7c-3a8a-45a7-8f3b-746de7e161fb None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.574733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5fc7c-3a8a-45a7-8f3b-746de7e161fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:44.575051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5fc7c-3a8a-45a7-8f3b-746de7e161fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.576841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5fc7c-3a8a-45a7-8f3b-746de7e161fb None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:44.593859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 20/34] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 14:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:44.594616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5fc7c-3a8a-45a7-8f3b-746de7e161fb None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.622304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986f227-57e8-496a-afdf-21bd93e6a0a6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.682787 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef201d-bc4d-4af5-a737-622db19dc1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.683971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef201d-bc4d-4af5-a737-622db19dc1ba None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.684504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef201d-bc4d-4af5-a737-622db19dc1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.685075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef201d-bc4d-4af5-a737-622db19dc1ba None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.686446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef201d-bc4d-4af5-a737-622db19dc1ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.688366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef201d-bc4d-4af5-a737-622db19dc1ba None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:44.727308 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 15/35] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 14:59:44 2022] POST /identity/v3/projects => generated 301 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:44.728326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef201d-bc4d-4af5-a737-622db19dc1ba None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.728461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5fc7c-3a8a-45a7-8f3b-746de7e161fb None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.742356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:44.757746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:44.792420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562b99e-a360-454a-9186-e208c907d9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.793132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562b99e-a360-454a-9186-e208c907d9dd None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.793420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562b99e-a360-454a-9186-e208c907d9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.793806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562b99e-a360-454a-9186-e208c907d9dd None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.794545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562b99e-a360-454a-9186-e208c907d9dd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.796041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562b99e-a360-454a-9186-e208c907d9dd None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:44.852220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef201d-bc4d-4af5-a737-622db19dc1ba None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:44.891787 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd77589-e730-4535-811c-f8d5c026a16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:44.892707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd77589-e730-4535-811c-f8d5c026a16e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.892998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd77589-e730-4535-811c-f8d5c026a16e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.893279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd77589-e730-4535-811c-f8d5c026a16e None admin] PATH_INFO: `/v3/users/ad3666eef9be46b0b4707636932d0a11` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.894787 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd77589-e730-4535-811c-f8d5c026a16e None admin] RBAC: Authorizing `identity:get_user(user_id=ad3666eef9be46b0b4707636932d0a11)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:44.896301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd77589-e730-4535-811c-f8d5c026a16e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:44.898513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 16/36] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 14:59:44 2022] GET /identity/v3/users/ad3666eef9be46b0b4707636932d0a11 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:44.900035 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016193bb-830e-410c-900f-9a61340c8d9a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.900376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016193bb-830e-410c-900f-9a61340c8d9a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.900664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016193bb-830e-410c-900f-9a61340c8d9a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.903307 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 17/37] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:44.905729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016193bb-830e-410c-900f-9a61340c8d9a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:44.932205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 21/38] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 14:59:44 2022] POST /identity/v3/roles => generated 219 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:44.933778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971e905-b363-4392-ba24-3261d2f1d7db None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:44.934077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971e905-b363-4392-ba24-3261d2f1d7db None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:44.934367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971e905-b363-4392-ba24-3261d2f1d7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:44.965205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-c971e905-b363-4392-ba24-3261d2f1d7db None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:44.966800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-c971e905-b363-4392-ba24-3261d2f1d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:45.004260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:45.030798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016193bb-830e-410c-900f-9a61340c8d9a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:45.048432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 22/39] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:59:45.071634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971e905-b363-4392-ba24-3261d2f1d7db None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:45.073713 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d83b5-8c66-44d8-888f-fae6dcc09e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:45.074733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d83b5-8c66-44d8-888f-fae6dcc09e09 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.075201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d83b5-8c66-44d8-888f-fae6dcc09e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.075491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d83b5-8c66-44d8-888f-fae6dcc09e09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.077253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d83b5-8c66-44d8-888f-fae6dcc09e09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:45.078856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d83b5-8c66-44d8-888f-fae6dcc09e09 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:45.080729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 18/40] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 14:59:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:45.086745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d83b5-8c66-44d8-888f-fae6dcc09e09 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:45.185086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971e905-b363-4392-ba24-3261d2f1d7db None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:45.193469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:45.203076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d83b5-8c66-44d8-888f-fae6dcc09e09 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:45.231949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ea85a-48a2-4b8b-bccd-7d8db3664aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:45.232775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ea85a-48a2-4b8b-bccd-7d8db3664aff None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.233030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ea85a-48a2-4b8b-bccd-7d8db3664aff None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.233322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ea85a-48a2-4b8b-bccd-7d8db3664aff None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.234117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ea85a-48a2-4b8b-bccd-7d8db3664aff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:45.235701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ea85a-48a2-4b8b-bccd-7d8db3664aff None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:45.244702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a4008-bf83-4c6a-a1c5-775f9000f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:45.246021 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a4008-bf83-4c6a-a1c5-775f9000f6f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.246304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a4008-bf83-4c6a-a1c5-775f9000f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.246645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a4008-bf83-4c6a-a1c5-775f9000f6f0 None admin] PATH_INFO: `/v3/domains/default/users/ad3666eef9be46b0b4707636932d0a11/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.248715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a4008-bf83-4c6a-a1c5-775f9000f6f0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ad3666eef9be46b0b4707636932d0a11, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:45.250189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a4008-bf83-4c6a-a1c5-775f9000f6f0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:45.251591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 23/41] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 14:59:45 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:59:45.263418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afa96a-c318-4c66-8165-acc2abdcf6c5 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.263790 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afa96a-c318-4c66-8165-acc2abdcf6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.264033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afa96a-c318-4c66-8165-acc2abdcf6c5 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.265565 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 24/42] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:59:45.267002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 19/43] 10.222.0.24 () {58 vars in 1361 bytes} [Wed May 25 14:59:45 2022] PUT /identity/v3/domains/default/users/ad3666eef9be46b0b4707636932d0a11/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:59:45.271072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1559bb-0fcd-4938-96d7-3378790e24e0 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.271372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1559bb-0fcd-4938-96d7-3378790e24e0 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.271701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1559bb-0fcd-4938-96d7-3378790e24e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.300929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-7e1559bb-0fcd-4938-96d7-3378790e24e0 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:45.302333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-7e1559bb-0fcd-4938-96d7-3378790e24e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:45.393257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 25/44] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:59:45.416766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a4008-bf83-4c6a-a1c5-775f9000f6f0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:45.426786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:45.534430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a4008-bf83-4c6a-a1c5-775f9000f6f0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:45.567801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6332b-0d85-4b74-9478-d2bb77c198f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:45.568554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6332b-0d85-4b74-9478-d2bb77c198f9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.568843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6332b-0d85-4b74-9478-d2bb77c198f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.569124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6332b-0d85-4b74-9478-d2bb77c198f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.570295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6332b-0d85-4b74-9478-d2bb77c198f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:45.571843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6332b-0d85-4b74-9478-d2bb77c198f9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:45.573647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 20/45] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 14:59:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:59:45.579607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1559bb-0fcd-4938-96d7-3378790e24e0 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:45.675794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:45.682513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1559bb-0fcd-4938-96d7-3378790e24e0 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:45.717638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9cc0-4720-49fb-bd38-13d8eecc74ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:45.718313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9cc0-4720-49fb-bd38-13d8eecc74ff None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:45.718610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9cc0-4720-49fb-bd38-13d8eecc74ff None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:45.718897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9cc0-4720-49fb-bd38-13d8eecc74ff None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:45.719651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc9cc0-4720-49fb-bd38-13d8eecc74ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:45.721150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc9cc0-4720-49fb-bd38-13d8eecc74ff None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:45.749966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 26/46] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 14:59:45 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:47.502192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98493c-6463-4448-b740-ae8d736dcbd2 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:47.502710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98493c-6463-4448-b740-ae8d736dcbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:47.502894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98493c-6463-4448-b740-ae8d736dcbd2 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:47.504298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 21/47] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:47.509968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24adf-34b4-48c7-b60c-22b65370c164 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:47.510400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24adf-34b4-48c7-b60c-22b65370c164 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:47.510662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24adf-34b4-48c7-b60c-22b65370c164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:47.528297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-03f24adf-34b4-48c7-b60c-22b65370c164 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:47.529498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-03f24adf-34b4-48c7-b60c-22b65370c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:47.601764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 27/48] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:59:47.625337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98493c-6463-4448-b740-ae8d736dcbd2 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:47.713328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:47.743982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98493c-6463-4448-b740-ae8d736dcbd2 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:47.782107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65d41d-9d9e-4d13-9818-4654a48c0d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:47.782941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65d41d-9d9e-4d13-9818-4654a48c0d99 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:47.783234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65d41d-9d9e-4d13-9818-4654a48c0d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:47.783520 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65d41d-9d9e-4d13-9818-4654a48c0d99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:47.796987 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65d41d-9d9e-4d13-9818-4654a48c0d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3b65d41d-9d9e-4d13-9818-4654a48c0d99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:59:47.806024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:59:47.807010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 14:59:47.807850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 22/49] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 14:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:59:47.814404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f24adf-34b4-48c7-b60c-22b65370c164 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:47.900076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:47.925024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f24adf-34b4-48c7-b60c-22b65370c164 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:47.961088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf1790-860c-496d-86f6-5361c874b27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:47.961773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf1790-860c-496d-86f6-5361c874b27b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:47.962063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf1790-860c-496d-86f6-5361c874b27b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:47.962344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf1790-860c-496d-86f6-5361c874b27b None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:47.963443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf1790-860c-496d-86f6-5361c874b27b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:47.963766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf1790-860c-496d-86f6-5361c874b27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:47.964825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ecb74-12a5-48b5-9861-3c5d949a4f34 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:47.965126 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ecb74-12a5-48b5-9861-3c5d949a4f34 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:47.965254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf1790-860c-496d-86f6-5361c874b27b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:47.965398 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ecb74-12a5-48b5-9861-3c5d949a4f34 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:47.966995 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 23/50] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:47.972743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c40ae-3c5f-4fa4-bfeb-7f3a834e5d00 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:47.973131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c40ae-3c5f-4fa4-bfeb-7f3a834e5d00 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:47.973402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c40ae-3c5f-4fa4-bfeb-7f3a834e5d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:47.974930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 28/51] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 14:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:47.980397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf1790-860c-496d-86f6-5361c874b27b None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:47.993434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6a0c40ae-3c5f-4fa4-bfeb-7f3a834e5d00 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:47.995040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6a0c40ae-3c5f-4fa4-bfeb-7f3a834e5d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:48.067357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 24/52] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:59:48.081879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf1790-860c-496d-86f6-5361c874b27b None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:48.093878 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c40ae-3c5f-4fa4-bfeb-7f3a834e5d00 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:48.122243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec3fca-c5c3-4298-a9e5-7c3bca8a0686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:48.123656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec3fca-c5c3-4298-a9e5-7c3bca8a0686 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:48.124099 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec3fca-c5c3-4298-a9e5-7c3bca8a0686 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:48.124469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec3fca-c5c3-4298-a9e5-7c3bca8a0686 None admin] PATH_INFO: `/v3/users/ad3666eef9be46b0b4707636932d0a11` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:48.125802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec3fca-c5c3-4298-a9e5-7c3bca8a0686 None admin] RBAC: Authorizing `identity:get_user(user_id=ad3666eef9be46b0b4707636932d0a11)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:48.127288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec3fca-c5c3-4298-a9e5-7c3bca8a0686 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:48.128990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 29/53] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 14:59:47 2022] GET /identity/v3/users/ad3666eef9be46b0b4707636932d0a11 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:59:48.134435 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec3fca-c5c3-4298-a9e5-7c3bca8a0686 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:48.145883 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:48.166471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:48.204470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c40ae-3c5f-4fa4-bfeb-7f3a834e5d00 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:48.240323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec3fca-c5c3-4298-a9e5-7c3bca8a0686 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:48.244361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d957c4-520b-4730-af2a-5d1a44c18716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:48.245376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d957c4-520b-4730-af2a-5d1a44c18716 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:48.245586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d957c4-520b-4730-af2a-5d1a44c18716 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:48.245995 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d957c4-520b-4730-af2a-5d1a44c18716 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:48.247529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d957c4-520b-4730-af2a-5d1a44c18716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:48.249367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d957c4-520b-4730-af2a-5d1a44c18716 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:48.251766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 25/54] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 14:59:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:48.257586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d957c4-520b-4730-af2a-5d1a44c18716 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:48.277656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba4986-a863-4679-aae3-75efa774864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:48.278477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba4986-a863-4679-aae3-75efa774864f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:48.278765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba4986-a863-4679-aae3-75efa774864f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:48.279048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba4986-a863-4679-aae3-75efa774864f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:48.280265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba4986-a863-4679-aae3-75efa774864f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:48.281860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba4986-a863-4679-aae3-75efa774864f None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:48.283517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 30/55] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 14:59:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:59:48.289266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba4986-a863-4679-aae3-75efa774864f None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:48.357781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d957c4-520b-4730-af2a-5d1a44c18716 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:48.366836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:48.389647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba4986-a863-4679-aae3-75efa774864f None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:48.389820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:48.395422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab4c1f-5f9c-4849-93ef-665517bf20ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:48.396131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab4c1f-5f9c-4849-93ef-665517bf20ec None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:48.396420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab4c1f-5f9c-4849-93ef-665517bf20ec None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:48.396704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab4c1f-5f9c-4849-93ef-665517bf20ec None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:48.397792 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab4c1f-5f9c-4849-93ef-665517bf20ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:48.400337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab4c1f-5f9c-4849-93ef-665517bf20ec None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:48.424726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c550fa8-c087-4e76-953d-40ce55f10385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:48.425445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550fa8-c087-4e76-953d-40ce55f10385 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:48.425737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550fa8-c087-4e76-953d-40ce55f10385 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:48.426069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550fa8-c087-4e76-953d-40ce55f10385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:48.426868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c550fa8-c087-4e76-953d-40ce55f10385 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.domain.id=default, user.id=ad3666eef9be46b0b4707636932d0a11) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:48.427184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c550fa8-c087-4e76-953d-40ce55f10385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:48.428692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c550fa8-c087-4e76-953d-40ce55f10385 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:48.429309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 26/56] 10.222.0.24 () {60 vars in 1140 bytes} [Wed May 25 14:59:48 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:59:48.436730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 31/57] 10.222.0.24 () {56 vars in 1322 bytes} [Wed May 25 14:59:48 2022] GET /identity/v3/role_assignments?user.id=ad3666eef9be46b0b4707636932d0a11&scope.domain.id=default&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:59:50.630018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8dbf5-d0a2-4057-ae9f-85267ff4a24e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:50.630569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8dbf5-d0a2-4057-ae9f-85267ff4a24e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:50.630569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8dbf5-d0a2-4057-ae9f-85267ff4a24e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:50.632001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 27/58] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:50.637496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ade57-3c20-42c6-97b4-df0cf066897e None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:50.637936 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ade57-3c20-42c6-97b4-df0cf066897e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:50.638042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ade57-3c20-42c6-97b4-df0cf066897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:50.655126 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-b89ade57-3c20-42c6-97b4-df0cf066897e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:50.656365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-b89ade57-3c20-42c6-97b4-df0cf066897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:50.725133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 32/59] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:59:50.749433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8dbf5-d0a2-4057-ae9f-85267ff4a24e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:50.857446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8dbf5-d0a2-4057-ae9f-85267ff4a24e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:50.891618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a6c52-f9f2-4cfd-9c7a-1280a3d5f19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:50.892432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a6c52-f9f2-4cfd-9c7a-1280a3d5f19d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:50.892714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a6c52-f9f2-4cfd-9c7a-1280a3d5f19d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:50.892992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a6c52-f9f2-4cfd-9c7a-1280a3d5f19d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:50.894203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a6c52-f9f2-4cfd-9c7a-1280a3d5f19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:50.895743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a6c52-f9f2-4cfd-9c7a-1280a3d5f19d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:50.897330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 28/60] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 14:59:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:50.903749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ade57-3c20-42c6-97b4-df0cf066897e None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:50.979249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:51.011113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ade57-3c20-42c6-97b4-df0cf066897e None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:51.044685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d2085-6fed-4bc4-84ee-d8dd0c62f0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:51.045348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2085-6fed-4bc4-84ee-d8dd0c62f0eb None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:51.045632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2085-6fed-4bc4-84ee-d8dd0c62f0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:51.045906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2085-6fed-4bc4-84ee-d8dd0c62f0eb None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:51.046618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d2085-6fed-4bc4-84ee-d8dd0c62f0eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:51.048105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d2085-6fed-4bc4-84ee-d8dd0c62f0eb None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:51.079134 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 33/61] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 14:59:50 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:54.287206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080527b-3bab-4047-aa8c-74174ecc919c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:54.288102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080527b-3bab-4047-aa8c-74174ecc919c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:54.288527 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080527b-3bab-4047-aa8c-74174ecc919c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:54.290152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 29/62] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:54.295846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03dbab-9484-469e-999e-32558bf63a25 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:54.296688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03dbab-9484-469e-999e-32558bf63a25 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:54.297180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03dbab-9484-469e-999e-32558bf63a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:54.320567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-fc03dbab-9484-469e-999e-32558bf63a25 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:54.322228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-fc03dbab-9484-469e-999e-32558bf63a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:54.410254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 34/63] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:59:54.457043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080527b-3bab-4047-aa8c-74174ecc919c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:54.529641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:54.567654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1854034-6e4e-4a99-95a8-34b3ce6f17e4 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:54.568248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1854034-6e4e-4a99-95a8-34b3ce6f17e4 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:54.568720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1854034-6e4e-4a99-95a8-34b3ce6f17e4 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:54.570321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 35/64] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:54.575845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ff596-bb26-44e9-a437-c7866fae41de None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:54.576374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ff596-bb26-44e9-a437-c7866fae41de None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:54.576841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ff596-bb26-44e9-a437-c7866fae41de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:54.603093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-452ff596-bb26-44e9-a437-c7866fae41de None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:54.604325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-452ff596-bb26-44e9-a437-c7866fae41de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:54.610938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080527b-3bab-4047-aa8c-74174ecc919c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:54.668932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356306d-40d4-4e7a-bc9f-d90c0fbef9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:54.669755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356306d-40d4-4e7a-bc9f-d90c0fbef9ba None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:54.670040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356306d-40d4-4e7a-bc9f-d90c0fbef9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:54.670317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356306d-40d4-4e7a-bc9f-d90c0fbef9ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:54.695730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356306d-40d4-4e7a-bc9f-d90c0fbef9ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-1356306d-40d4-4e7a-bc9f-d90c0fbef9ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:59:54.709658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:59:54.710518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 14:59:54.711292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 30/65] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 14:59:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:59:54.723408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc54ed-0c11-4ded-9a87-d856914f6e90 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:54.723725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc54ed-0c11-4ded-9a87-d856914f6e90 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:54.724018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc54ed-0c11-4ded-9a87-d856914f6e90 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:54.725632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 31/66] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:54.726345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc54ed-0c11-4ded-9a87-d856914f6e90 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:54.734194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:54.736620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 36/67] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:59:54.738347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5504-c45d-4744-95cf-a3739ed7b97e None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:54.738864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5504-c45d-4744-95cf-a3739ed7b97e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:54.739340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5504-c45d-4744-95cf-a3739ed7b97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:54.763481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-f24d5504-c45d-4744-95cf-a3739ed7b97e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:54.765315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-f24d5504-c45d-4744-95cf-a3739ed7b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:54.837770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 37/68] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:59:54.839174 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5504-c45d-4744-95cf-a3739ed7b97e None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:54.860985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc54ed-0c11-4ded-9a87-d856914f6e90 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:54.876827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:54.901965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a550c8-754d-4ea3-8a3a-75209afee19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:54.903031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a550c8-754d-4ea3-8a3a-75209afee19b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:54.903470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a550c8-754d-4ea3-8a3a-75209afee19b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:54.903926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a550c8-754d-4ea3-8a3a-75209afee19b None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:54.904701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a550c8-754d-4ea3-8a3a-75209afee19b None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:54.905015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a550c8-754d-4ea3-8a3a-75209afee19b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:54.906624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a550c8-754d-4ea3-8a3a-75209afee19b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:54.919658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 32/69] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 14:59:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:54.920752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a550c8-754d-4ea3-8a3a-75209afee19b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:54.949955 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5504-c45d-4744-95cf-a3739ed7b97e None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:54.968081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:54.989521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa4cb-f484-4790-b558-9ca6dffd28fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:54.990593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa4cb-f484-4790-b558-9ca6dffd28fc None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:54.991028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa4cb-f484-4790-b558-9ca6dffd28fc None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:54.991456 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa4cb-f484-4790-b558-9ca6dffd28fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.005150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afa4cb-f484-4790-b558-9ca6dffd28fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-46afa4cb-f484-4790-b558-9ca6dffd28fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:59:55.013412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:59:55.014525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:59:55.015414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:59:55.015414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 14:59:55.015414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:59:55.015414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 14:59:55.015414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:59:55.015414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:59:55.015414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:59:55.015414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:59:55.015414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:59:55.015414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:59:55.015414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:59:55.015414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 14:59:55.017374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 38/70] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 14:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:59:55.018299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa4cb-f484-4790-b558-9ca6dffd28fc None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:55.035624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a550c8-754d-4ea3-8a3a-75209afee19b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.065965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0a3e9-dd85-47d6-803f-864707db55ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:55.066793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0a3e9-dd85-47d6-803f-864707db55ab None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.067076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0a3e9-dd85-47d6-803f-864707db55ab None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.067352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0a3e9-dd85-47d6-803f-864707db55ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.077387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0a3e9-dd85-47d6-803f-864707db55ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-92d0a3e9-dd85-47d6-803f-864707db55ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:59:55.085505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:59:55.086381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 33/71] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 14:59:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:59:55.088202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0a3e9-dd85-47d6-803f-864707db55ab None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:55.124455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:55.125000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa4cb-f484-4790-b558-9ca6dffd28fc None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.160345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eda3e1-b86e-429c-ad38-69007bb4c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:55.161237 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eda3e1-b86e-429c-ad38-69007bb4c215 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.161518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eda3e1-b86e-429c-ad38-69007bb4c215 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.161794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eda3e1-b86e-429c-ad38-69007bb4c215 None admin] PATH_INFO: `/v3/users/cf9d84554d9c4cf2a39183e67800c82b` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.175437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eda3e1-b86e-429c-ad38-69007bb4c215 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9d84554d9c4cf2a39183e67800c82b)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:55.176948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eda3e1-b86e-429c-ad38-69007bb4c215 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:55.178627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 39/72] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 14:59:55 2022] GET /identity/v3/users/cf9d84554d9c4cf2a39183e67800c82b => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:55.179960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4df44-659e-4606-8740-c0dac66d8bbb None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.180253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4df44-659e-4606-8740-c0dac66d8bbb None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.180546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4df44-659e-4606-8740-c0dac66d8bbb None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.181964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 40/73] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:55.187103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada4f35-c926-4630-b5c3-64faabd4f475 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.187422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada4f35-c926-4630-b5c3-64faabd4f475 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.187703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada4f35-c926-4630-b5c3-64faabd4f475 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.188982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 41/74] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:55.193145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada4f35-c926-4630-b5c3-64faabd4f475 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:55.193232 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0a3e9-dd85-47d6-803f-864707db55ab None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.223142 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cae35-3a36-42b6-9e7b-1089fc05ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:55.223856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cae35-3a36-42b6-9e7b-1089fc05ad06 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.224144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cae35-3a36-42b6-9e7b-1089fc05ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.224423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cae35-3a36-42b6-9e7b-1089fc05ad06 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.225185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cae35-3a36-42b6-9e7b-1089fc05ad06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:55.225279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:55.225500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cae35-3a36-42b6-9e7b-1089fc05ad06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:55.227034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cae35-3a36-42b6-9e7b-1089fc05ad06 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:55.235377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 34/75] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 14:59:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:55.236280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cae35-3a36-42b6-9e7b-1089fc05ad06 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:55.294472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada4f35-c926-4630-b5c3-64faabd4f475 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.327597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa9781-715c-4e25-b4aa-a0aefbf26364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:55.328272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa9781-715c-4e25-b4aa-a0aefbf26364 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.328575 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa9781-715c-4e25-b4aa-a0aefbf26364 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.328861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa9781-715c-4e25-b4aa-a0aefbf26364 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.328950 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:55.329631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa9781-715c-4e25-b4aa-a0aefbf26364 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:55.329949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa9781-715c-4e25-b4aa-a0aefbf26364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:55.331331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa9781-715c-4e25-b4aa-a0aefbf26364 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:55.335294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cae35-3a36-42b6-9e7b-1089fc05ad06 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.339620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 42/76] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 14:59:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:55.340766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7d769-240c-4f02-a371-3e67f1432941 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.341056 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7d769-240c-4f02-a371-3e67f1432941 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.341336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7d769-240c-4f02-a371-3e67f1432941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.358345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-69c7d769-240c-4f02-a371-3e67f1432941 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:55.359540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-69c7d769-240c-4f02-a371-3e67f1432941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:55.371904 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a20110-85c8-4c93-9846-1a6a8589cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:55.372570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a20110-85c8-4c93-9846-1a6a8589cb1a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.372890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a20110-85c8-4c93-9846-1a6a8589cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.373145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a20110-85c8-4c93-9846-1a6a8589cb1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.427978 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 43/77] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:59:55.439717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6cc8-731b-4cfa-be85-12476dc24179 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.439717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6cc8-731b-4cfa-be85-12476dc24179 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.439717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6cc8-731b-4cfa-be85-12476dc24179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.446615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-0e0e6cc8-731b-4cfa-be85-12476dc24179 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:55.447856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-0e0e6cc8-731b-4cfa-be85-12476dc24179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:55.455704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a20110-85c8-4c93-9846-1a6a8589cb1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:55.457175 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a20110-85c8-4c93-9846-1a6a8589cb1a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:55.469478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:55.516419 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 44/78] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:59:55.519734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e6cc8-731b-4cfa-be85-12476dc24179 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:55.555157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:55.562479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 35/79] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 14:59:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:59:55.568135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a20110-85c8-4c93-9846-1a6a8589cb1a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:55.630423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e6cc8-731b-4cfa-be85-12476dc24179 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.663836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a20110-85c8-4c93-9846-1a6a8589cb1a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.664641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc29d1-2c23-4a76-8c38-491a7c0a4882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:55.665525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc29d1-2c23-4a76-8c38-491a7c0a4882 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.665815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc29d1-2c23-4a76-8c38-491a7c0a4882 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.666089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc29d1-2c23-4a76-8c38-491a7c0a4882 None admin] PATH_INFO: `/v3/users/ad3666eef9be46b0b4707636932d0a11` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.667334 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc29d1-2c23-4a76-8c38-491a7c0a4882 None admin] RBAC: Authorizing `identity:get_user(user_id=ad3666eef9be46b0b4707636932d0a11)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:55.668829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc29d1-2c23-4a76-8c38-491a7c0a4882 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:55.670455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 45/80] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 14:59:55 2022] GET /identity/v3/users/ad3666eef9be46b0b4707636932d0a11 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:55.671206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc29d1-2c23-4a76-8c38-491a7c0a4882 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:55.694809 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:55.702091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b357e2-bc9f-4567-a376-f04d7a5db987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:55.703007 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b357e2-bc9f-4567-a376-f04d7a5db987 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.703297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b357e2-bc9f-4567-a376-f04d7a5db987 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.703656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b357e2-bc9f-4567-a376-f04d7a5db987 None admin] PATH_INFO: `/v3/users/cf9d84554d9c4cf2a39183e67800c82b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.704816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b357e2-bc9f-4567-a376-f04d7a5db987 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9d84554d9c4cf2a39183e67800c82b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:55.706292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b357e2-bc9f-4567-a376-f04d7a5db987 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:55.707965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 36/81] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 14:59:55 2022] GET /identity/v3/users/cf9d84554d9c4cf2a39183e67800c82b => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:55.712437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b357e2-bc9f-4567-a376-f04d7a5db987 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:55.766993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc29d1-2c23-4a76-8c38-491a7c0a4882 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.773521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:55.801641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e85dd5-ccd4-4dae-b92a-6e4b0f3ed214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:55.802474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e85dd5-ccd4-4dae-b92a-6e4b0f3ed214 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.802756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e85dd5-ccd4-4dae-b92a-6e4b0f3ed214 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.803035 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e85dd5-ccd4-4dae-b92a-6e4b0f3ed214 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.804253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e85dd5-ccd4-4dae-b92a-6e4b0f3ed214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:55.805715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e85dd5-ccd4-4dae-b92a-6e4b0f3ed214 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:55.807345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 46/82] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 14:59:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:55.812053 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e85dd5-ccd4-4dae-b92a-6e4b0f3ed214 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:55.815811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b357e2-bc9f-4567-a376-f04d7a5db987 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.851076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2477bd-81b2-4ebc-bf3e-1564309e0815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:55.851930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2477bd-81b2-4ebc-bf3e-1564309e0815 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.852222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2477bd-81b2-4ebc-bf3e-1564309e0815 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.852498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2477bd-81b2-4ebc-bf3e-1564309e0815 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.863391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2477bd-81b2-4ebc-bf3e-1564309e0815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2c2477bd-81b2-4ebc-bf3e-1564309e0815 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:59:55.871222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:59:55.872107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 37/83] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 14:59:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:59:55.878051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2477bd-81b2-4ebc-bf3e-1564309e0815 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:55.896351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:55.905528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e85dd5-ccd4-4dae-b92a-6e4b0f3ed214 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.938120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a3e6f-7049-4fa8-a0ac-39d976f130ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:55.938998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a3e6f-7049-4fa8-a0ac-39d976f130ab None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:55.939274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a3e6f-7049-4fa8-a0ac-39d976f130ab None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:55.939547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a3e6f-7049-4fa8-a0ac-39d976f130ab None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:55.940754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a3e6f-7049-4fa8-a0ac-39d976f130ab None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:55.942208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a3e6f-7049-4fa8-a0ac-39d976f130ab None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:55.943940 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 47/84] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 14:59:55 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:55.944693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a3e6f-7049-4fa8-a0ac-39d976f130ab None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:55.975467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2477bd-81b2-4ebc-bf3e-1564309e0815 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:55.997697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:56.008187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cff950-ba38-479b-a702-633038b3d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.008917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cff950-ba38-479b-a702-633038b3d53d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.009206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cff950-ba38-479b-a702-633038b3d53d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.009484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cff950-ba38-479b-a702-633038b3d53d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.041210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a3e6f-7049-4fa8-a0ac-39d976f130ab None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:56.075475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cff950-ba38-479b-a702-633038b3d53d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.076085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41293f-aecc-4932-a820-ea7464b8c851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.076736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41293f-aecc-4932-a820-ea7464b8c851 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.076989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cff950-ba38-479b-a702-633038b3d53d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:56.077104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41293f-aecc-4932-a820-ea7464b8c851 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.077289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41293f-aecc-4932-a820-ea7464b8c851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.106459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:56.146931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41293f-aecc-4932-a820-ea7464b8c851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.148376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41293f-aecc-4932-a820-ea7464b8c851 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:56.174290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 38/85] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 14:59:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:59:56.175302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cff950-ba38-479b-a702-633038b3d53d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:56.200195 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:56.250876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 48/86] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 14:59:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:59:56.251980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41293f-aecc-4932-a820-ea7464b8c851 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:56.280484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cff950-ba38-479b-a702-633038b3d53d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:56.308465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:56.314203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e44f0-4f5b-4855-ab28-49dc269ab28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.314915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e44f0-4f5b-4855-ab28-49dc269ab28d None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.315201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e44f0-4f5b-4855-ab28-49dc269ab28d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.315479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e44f0-4f5b-4855-ab28-49dc269ab28d None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.316263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e44f0-4f5b-4855-ab28-49dc269ab28d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.317710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e44f0-4f5b-4855-ab28-49dc269ab28d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:56.344162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 39/87] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 14:59:56 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:59:56.344783 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e44f0-4f5b-4855-ab28-49dc269ab28d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:56.359310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41293f-aecc-4932-a820-ea7464b8c851 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:56.399186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94493264-e49a-4e9b-a621-00052b431816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.399822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94493264-e49a-4e9b-a621-00052b431816 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.400109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94493264-e49a-4e9b-a621-00052b431816 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.400394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94493264-e49a-4e9b-a621-00052b431816 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.401170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94493264-e49a-4e9b-a621-00052b431816 None admin] RBAC: Adding query filter params (name=member) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:56.401480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94493264-e49a-4e9b-a621-00052b431816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.402942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94493264-e49a-4e9b-a621-00052b431816 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:56.412614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 49/88] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 14:59:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:56.418630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94493264-e49a-4e9b-a621-00052b431816 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:56.442655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:56.462047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e44f0-4f5b-4855-ab28-49dc269ab28d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:56.500080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a60848-d3fb-4290-97a0-ce08dc3e28ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.500895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a60848-d3fb-4290-97a0-ce08dc3e28ba None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.501186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a60848-d3fb-4290-97a0-ce08dc3e28ba None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.501519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a60848-d3fb-4290-97a0-ce08dc3e28ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.502331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a60848-d3fb-4290-97a0-ce08dc3e28ba None admin] RBAC: Adding query filter params (role.id=88c41930377947b7a1dc0134ba0f787b, scope.project.id=903a0b97a2f547ba915abf85091b8d33, user.id=cf9d84554d9c4cf2a39183e67800c82b) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:56.502651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a60848-d3fb-4290-97a0-ce08dc3e28ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.504721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a60848-d3fb-4290-97a0-ce08dc3e28ba None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:56.513213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 40/89] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 14:59:56 2022] GET /identity/v3/role_assignments?user.id=cf9d84554d9c4cf2a39183e67800c82b&scope.project.id=903a0b97a2f547ba915abf85091b8d33&role.id=88c41930377947b7a1dc0134ba0f787b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:56.514074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a60848-d3fb-4290-97a0-ce08dc3e28ba None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:56.549457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94493264-e49a-4e9b-a621-00052b431816 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:56.577346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:56.594894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efc6df-6f90-411a-9061-7efd4e64d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.596036 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efc6df-6f90-411a-9061-7efd4e64d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.596331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efc6df-6f90-411a-9061-7efd4e64d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.596617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efc6df-6f90-411a-9061-7efd4e64d4f1 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.597959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efc6df-6f90-411a-9061-7efd4e64d4f1 None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.599512 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efc6df-6f90-411a-9061-7efd4e64d4f1 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:56.601517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 50/90] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 14:59:56 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:56.602162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efc6df-6f90-411a-9061-7efd4e64d4f1 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:56.655495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a60848-d3fb-4290-97a0-ce08dc3e28ba None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:56.696891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef68b-7151-4dab-bf7e-8993cee1a479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.697797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef68b-7151-4dab-bf7e-8993cee1a479 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.698086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef68b-7151-4dab-bf7e-8993cee1a479 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.698834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef68b-7151-4dab-bf7e-8993cee1a479 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.700650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdef68b-7151-4dab-bf7e-8993cee1a479 None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.702457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdef68b-7151-4dab-bf7e-8993cee1a479 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:56.705037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 41/91] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 14:59:56 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:56.706004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef68b-7151-4dab-bf7e-8993cee1a479 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:56.728788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:56.728989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efc6df-6f90-411a-9061-7efd4e64d4f1 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:56.780777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0f601-9f4c-4aa3-acb0-9971cd08c73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.781683 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0f601-9f4c-4aa3-acb0-9971cd08c73b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.781982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0f601-9f4c-4aa3-acb0-9971cd08c73b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.782243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0f601-9f4c-4aa3-acb0-9971cd08c73b None admin] PATH_INFO: `/v3/users/cf9d84554d9c4cf2a39183e67800c82b` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.783466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0f601-9f4c-4aa3-acb0-9971cd08c73b None admin] RBAC: Authorizing `identity:get_user(user_id=cf9d84554d9c4cf2a39183e67800c82b)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.784983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0f601-9f4c-4aa3-acb0-9971cd08c73b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:56.786826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 51/92] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 14:59:56 2022] GET /identity/v3/users/cf9d84554d9c4cf2a39183e67800c82b => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:56.787391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0f601-9f4c-4aa3-acb0-9971cd08c73b None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:56.842351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef68b-7151-4dab-bf7e-8993cee1a479 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:56.852016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:56.887036 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f476e2-8f29-45f8-ae53-89e3f10fcc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.887836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f476e2-8f29-45f8-ae53-89e3f10fcc5a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.888188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f476e2-8f29-45f8-ae53-89e3f10fcc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.888979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f476e2-8f29-45f8-ae53-89e3f10fcc5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.890277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f476e2-8f29-45f8-ae53-89e3f10fcc5a None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=903a0b97a2f547ba915abf85091b8d33, user.id=ad3666eef9be46b0b4707636932d0a11) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:56.890697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f476e2-8f29-45f8-ae53-89e3f10fcc5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.892817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f476e2-8f29-45f8-ae53-89e3f10fcc5a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:56.900447 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 42/93] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 14:59:56 2022] GET /identity/v3/role_assignments?user.id=ad3666eef9be46b0b4707636932d0a11&scope.project.id=903a0b97a2f547ba915abf85091b8d33&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:56.901269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f476e2-8f29-45f8-ae53-89e3f10fcc5a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:56.901832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0f601-9f4c-4aa3-acb0-9971cd08c73b None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:56.965630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67870919-5058-438a-bccd-348c12b082ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:56.966237 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67870919-5058-438a-bccd-348c12b082ed None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:56.966529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67870919-5058-438a-bccd-348c12b082ed None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:56.966813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67870919-5058-438a-bccd-348c12b082ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:56.967823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67870919-5058-438a-bccd-348c12b082ed None admin] RBAC: Adding query filter params (role.id=47a961686ccc4c6a8bb05e0f3fe5ffba, scope.project.id=903a0b97a2f547ba915abf85091b8d33, user.id=cf9d84554d9c4cf2a39183e67800c82b) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:56.968151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67870919-5058-438a-bccd-348c12b082ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:56.970073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67870919-5058-438a-bccd-348c12b082ed None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:56.985505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 52/94] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 14:59:56 2022] GET /identity/v3/role_assignments?user.id=cf9d84554d9c4cf2a39183e67800c82b&scope.project.id=903a0b97a2f547ba915abf85091b8d33&role.id=47a961686ccc4c6a8bb05e0f3fe5ffba => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:56.996026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:57.042299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f476e2-8f29-45f8-ae53-89e3f10fcc5a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:57.098432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda0914-64b8-4a5b-bca0-8d6da8c9f422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:57.099122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda0914-64b8-4a5b-bca0-8d6da8c9f422 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:57.099416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda0914-64b8-4a5b-bca0-8d6da8c9f422 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:57.099725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda0914-64b8-4a5b-bca0-8d6da8c9f422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:57.186616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda0914-64b8-4a5b-bca0-8d6da8c9f422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:57.188233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda0914-64b8-4a5b-bca0-8d6da8c9f422 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:57.295972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:57.326399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 43/95] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 14:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:59:57.331860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67870919-5058-438a-bccd-348c12b082ed None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:57.469347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67870919-5058-438a-bccd-348c12b082ed None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:57.503258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:57.530191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5f810-53dc-4322-b419-bb769d19840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:57.531138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f810-53dc-4322-b419-bb769d19840b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:57.531427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f810-53dc-4322-b419-bb769d19840b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:57.531735 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f810-53dc-4322-b419-bb769d19840b None admin] PATH_INFO: `/v3/projects/4a71790f77a34a0eb614716223b07504` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:57.532994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5f810-53dc-4322-b419-bb769d19840b None admin] RBAC: Authorizing `identity:get_project(project_id=4a71790f77a34a0eb614716223b07504)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:57.534478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5f810-53dc-4322-b419-bb769d19840b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:57.536257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 53/96] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 14:59:57 2022] GET /identity/v3/projects/4a71790f77a34a0eb614716223b07504 => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:57.542097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda0914-64b8-4a5b-bca0-8d6da8c9f422 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:57.655893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda0914-64b8-4a5b-bca0-8d6da8c9f422 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:57.689980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d55df3-d4a2-43af-9c6c-3499535aeee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:57.690655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d55df3-d4a2-43af-9c6c-3499535aeee4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:57.690943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d55df3-d4a2-43af-9c6c-3499535aeee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:57.691225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d55df3-d4a2-43af-9c6c-3499535aeee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:57.692187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d55df3-d4a2-43af-9c6c-3499535aeee4 None admin] RBAC: Adding query filter params (role.id=88c41930377947b7a1dc0134ba0f787b, scope.project.id=4a71790f77a34a0eb614716223b07504, user.id=cf9d84554d9c4cf2a39183e67800c82b) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:57.692509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d55df3-d4a2-43af-9c6c-3499535aeee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:57.693981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d55df3-d4a2-43af-9c6c-3499535aeee4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:57.701620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 44/97] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 14:59:57 2022] GET /identity/v3/role_assignments?user.id=cf9d84554d9c4cf2a39183e67800c82b&scope.project.id=4a71790f77a34a0eb614716223b07504&role.id=88c41930377947b7a1dc0134ba0f787b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:59.413161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b1a9-7982-4db2-8ee6-d77aa308dacb None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:59.413680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b1a9-7982-4db2-8ee6-d77aa308dacb None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:59.413754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b1a9-7982-4db2-8ee6-d77aa308dacb None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:59.415375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 54/98] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:59.420785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb095b9e-85b6-4be0-8d05-d8afef433b38 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:59.421203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb095b9e-85b6-4be0-8d05-d8afef433b38 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:59.421461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb095b9e-85b6-4be0-8d05-d8afef433b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:59.444655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-eb095b9e-85b6-4be0-8d05-d8afef433b38 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:59.446227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-eb095b9e-85b6-4be0-8d05-d8afef433b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:59.495086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:59.503239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d2512-0826-4619-8fa8-be36b8888579 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:59.503541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d2512-0826-4619-8fa8-be36b8888579 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:59.503874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d2512-0826-4619-8fa8-be36b8888579 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:59.505277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 55/99] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 14:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:59:59.512959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4f07-3adb-484c-9eb5-d96049374d25 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:59.513255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4f07-3adb-484c-9eb5-d96049374d25 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:59.513548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4f07-3adb-484c-9eb5-d96049374d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:59.531833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 45/100] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:59:59.546400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-084f4f07-3adb-484c-9eb5-d96049374d25 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:59:59.547720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-084f4f07-3adb-484c-9eb5-d96049374d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:59:59.556215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb095b9e-85b6-4be0-8d05-d8afef433b38 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:59.659114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb095b9e-85b6-4be0-8d05-d8afef433b38 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:59.697623 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 56/101] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 14:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:59:59.698810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725749bc-5ce3-45a2-ad2a-7df5f91bedf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:59.699676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725749bc-5ce3-45a2-ad2a-7df5f91bedf5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:59.699969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725749bc-5ce3-45a2-ad2a-7df5f91bedf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:59.700247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725749bc-5ce3-45a2-ad2a-7df5f91bedf5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:59.711416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725749bc-5ce3-45a2-ad2a-7df5f91bedf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-725749bc-5ce3-45a2-ad2a-7df5f91bedf5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:59:59.719320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:59:59.720185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 14:59:59.722252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 46/102] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 14:59:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:59:59.726899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f4f07-3adb-484c-9eb5-d96049374d25 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:59.748625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725749bc-5ce3-45a2-ad2a-7df5f91bedf5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:59:59.805824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:59.904982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f4f07-3adb-484c-9eb5-d96049374d25 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:59.909554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725749bc-5ce3-45a2-ad2a-7df5f91bedf5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:59:59.949824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:59:59.968333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0db3b0-8f7e-40af-ae1a-2ba340732a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:59.969092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0db3b0-8f7e-40af-ae1a-2ba340732a80 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:59.969383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0db3b0-8f7e-40af-ae1a-2ba340732a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:59.969669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0db3b0-8f7e-40af-ae1a-2ba340732a80 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:59.970444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0db3b0-8f7e-40af-ae1a-2ba340732a80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:59:59.970759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0db3b0-8f7e-40af-ae1a-2ba340732a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:59:59.972203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0db3b0-8f7e-40af-ae1a-2ba340732a80 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:59:59.973654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4547ac-fa07-436b-8246-741b7438ebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:59:59.974705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4547ac-fa07-436b-8246-741b7438ebff None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:59:59.975374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4547ac-fa07-436b-8246-741b7438ebff None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:59:59.975688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4547ac-fa07-436b-8246-741b7438ebff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:59:59.990103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 57/103] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 14:59:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:59:59.997019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0db3b0-8f7e-40af-ae1a-2ba340732a80 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:00.006137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4547ac-fa07-436b-8246-741b7438ebff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-eb4547ac-fa07-436b-8246-741b7438ebff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:00.019043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:00.020003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:00.020907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:00.020907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:00.020907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:00.020907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:00.020907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:00.020907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:00.020907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:00.020907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:00.020907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:00.020907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:00.020907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:00.020907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:00.021490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 47/104] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 14:59:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:00.022778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbba3e4-25c1-4470-8549-8d760c7bc437 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.023075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbba3e4-25c1-4470-8549-8d760c7bc437 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.023361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbba3e4-25c1-4470-8549-8d760c7bc437 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.024685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 48/105] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:00.028722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbba3e4-25c1-4470-8549-8d760c7bc437 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:00.134078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0db3b0-8f7e-40af-ae1a-2ba340732a80 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:00.140699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:00.153196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbba3e4-25c1-4470-8549-8d760c7bc437 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:00.168705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bcea7-2256-4e66-82fe-c5525c3a460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:00.169468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bcea7-2256-4e66-82fe-c5525c3a460e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.169760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bcea7-2256-4e66-82fe-c5525c3a460e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.170044 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bcea7-2256-4e66-82fe-c5525c3a460e None admin] PATH_INFO: `/v3/users/e404761da2934fe3a03e6c59ab6d6621` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.184198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bcea7-2256-4e66-82fe-c5525c3a460e None admin] RBAC: Authorizing `identity:get_user(user_id=e404761da2934fe3a03e6c59ab6d6621)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:00.185729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bcea7-2256-4e66-82fe-c5525c3a460e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:00.187840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 58/106] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 14:59:59 2022] GET /identity/v3/users/e404761da2934fe3a03e6c59ab6d6621 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:00.189333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100110e-18ed-4c5d-a937-9a7ab89f5342 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.189615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100110e-18ed-4c5d-a937-9a7ab89f5342 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.189900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100110e-18ed-4c5d-a937-9a7ab89f5342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.191366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e4be6-6bc3-4dee-9628-638169dc6969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:00.192451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e4be6-6bc3-4dee-9628-638169dc6969 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.192931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e4be6-6bc3-4dee-9628-638169dc6969 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.193388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e4be6-6bc3-4dee-9628-638169dc6969 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.194234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e4be6-6bc3-4dee-9628-638169dc6969 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:00.194616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e4be6-6bc3-4dee-9628-638169dc6969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:00.197026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e4be6-6bc3-4dee-9628-638169dc6969 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:00.206033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 49/107] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:00.211376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f7110-bbb4-49fd-a65b-73f00dd1f02f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.211376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f7110-bbb4-49fd-a65b-73f00dd1f02f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.211376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f7110-bbb4-49fd-a65b-73f00dd1f02f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.211376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 50/108] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:00.211376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f7110-bbb4-49fd-a65b-73f00dd1f02f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:00.212863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-2100110e-18ed-4c5d-a937-9a7ab89f5342 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:00.214333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-2100110e-18ed-4c5d-a937-9a7ab89f5342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:00.250724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:00.284365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 59/109] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:00.285587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100110e-18ed-4c5d-a937-9a7ab89f5342 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:00.324729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f7110-bbb4-49fd-a65b-73f00dd1f02f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:00.362784 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32d01f-fd86-4b15-adce-7bc1df55bab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:00.363449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32d01f-fd86-4b15-adce-7bc1df55bab3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.363767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32d01f-fd86-4b15-adce-7bc1df55bab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.364106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32d01f-fd86-4b15-adce-7bc1df55bab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.388777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:00.390916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100110e-18ed-4c5d-a937-9a7ab89f5342 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:00.429213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffcab5-e82c-424a-82bb-c43268fe1a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:00.431444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffcab5-e82c-424a-82bb-c43268fe1a74 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.431898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffcab5-e82c-424a-82bb-c43268fe1a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.432351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffcab5-e82c-424a-82bb-c43268fe1a74 None admin] PATH_INFO: `/v3/users/cf9d84554d9c4cf2a39183e67800c82b` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.433738 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffcab5-e82c-424a-82bb-c43268fe1a74 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9d84554d9c4cf2a39183e67800c82b)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:00.436228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffcab5-e82c-424a-82bb-c43268fe1a74 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:00.438989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 60/110] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:00 2022] GET /identity/v3/users/cf9d84554d9c4cf2a39183e67800c82b => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:00.440411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33ca6a-3cd6-43ab-a912-23de9be4d7d9 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.440853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33ca6a-3cd6-43ab-a912-23de9be4d7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.441258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33ca6a-3cd6-43ab-a912-23de9be4d7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.458146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32d01f-fd86-4b15-adce-7bc1df55bab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:00.460135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32d01f-fd86-4b15-adce-7bc1df55bab3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:00.464200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-9c33ca6a-3cd6-43ab-a912-23de9be4d7d9 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:00.465624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-9c33ca6a-3cd6-43ab-a912-23de9be4d7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:00.508431 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:00.561393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 61/111] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:00.562552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33ca6a-3cd6-43ab-a912-23de9be4d7d9 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:00.599425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 51/112] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:00.600567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32d01f-fd86-4b15-adce-7bc1df55bab3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:00.666881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:00.675687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33ca6a-3cd6-43ab-a912-23de9be4d7d9 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:00.721199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384ffb6-ea7e-48b1-92bd-afec95babc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:00.721931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384ffb6-ea7e-48b1-92bd-afec95babc59 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.722589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384ffb6-ea7e-48b1-92bd-afec95babc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.722877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384ffb6-ea7e-48b1-92bd-afec95babc59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.723549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32d01f-fd86-4b15-adce-7bc1df55bab3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:00.733455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384ffb6-ea7e-48b1-92bd-afec95babc59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-5384ffb6-ea7e-48b1-92bd-afec95babc59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:00.741184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:00.742064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 62/113] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:00.747802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384ffb6-ea7e-48b1-92bd-afec95babc59 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:00.767756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e810a-ea3e-4a9a-aadd-034132895418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:00.768761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e810a-ea3e-4a9a-aadd-034132895418 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.769051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e810a-ea3e-4a9a-aadd-034132895418 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.769331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e810a-ea3e-4a9a-aadd-034132895418 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.770534 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e810a-ea3e-4a9a-aadd-034132895418 None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:00.772260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e810a-ea3e-4a9a-aadd-034132895418 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:00.774345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 52/114] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:00 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:00.779115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:00.780261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e810a-ea3e-4a9a-aadd-034132895418 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:00.848209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384ffb6-ea7e-48b1-92bd-afec95babc59 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:00.881704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e810a-ea3e-4a9a-aadd-034132895418 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:00.885072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101fd82-0cee-4e8d-bcd2-94af48d89fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:00.885896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101fd82-0cee-4e8d-bcd2-94af48d89fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.886184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101fd82-0cee-4e8d-bcd2-94af48d89fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.886468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101fd82-0cee-4e8d-bcd2-94af48d89fc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.887723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101fd82-0cee-4e8d-bcd2-94af48d89fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:00.889217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101fd82-0cee-4e8d-bcd2-94af48d89fc0 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:00.890871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 63/115] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:00.895763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98495631-da92-4925-9a21-f682f3e8dc49 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.895763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98495631-da92-4925-9a21-f682f3e8dc49 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.895763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98495631-da92-4925-9a21-f682f3e8dc49 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.895763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 64/116] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:00.895763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98495631-da92-4925-9a21-f682f3e8dc49 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:00.911216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:00.927832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343eb50-967a-4bb0-aa2b-b03c68620fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:00.928956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343eb50-967a-4bb0-aa2b-b03c68620fbc None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:00.929080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343eb50-967a-4bb0-aa2b-b03c68620fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:00.929439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343eb50-967a-4bb0-aa2b-b03c68620fbc None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:00.930695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343eb50-967a-4bb0-aa2b-b03c68620fbc None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:00.932190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343eb50-967a-4bb0-aa2b-b03c68620fbc None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:00.934107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 53/117] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:00 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:00.934778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343eb50-967a-4bb0-aa2b-b03c68620fbc None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:00.998465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:01.006922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98495631-da92-4925-9a21-f682f3e8dc49 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:01.035235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343eb50-967a-4bb0-aa2b-b03c68620fbc None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:01.042958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5a949-b399-4c4b-8254-ac5a06cee220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:01.043433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5a949-b399-4c4b-8254-ac5a06cee220 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:01.043755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5a949-b399-4c4b-8254-ac5a06cee220 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:01.044042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5a949-b399-4c4b-8254-ac5a06cee220 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:01.044811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5a949-b399-4c4b-8254-ac5a06cee220 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:01.045285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5a949-b399-4c4b-8254-ac5a06cee220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:01.046674 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5a949-b399-4c4b-8254-ac5a06cee220 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:01.055313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 65/118] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:01.058402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5a949-b399-4c4b-8254-ac5a06cee220 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:01.068989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364596d3-6117-406b-9b1b-b01206f04063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:01.069900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364596d3-6117-406b-9b1b-b01206f04063 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:01.070177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364596d3-6117-406b-9b1b-b01206f04063 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:01.070463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364596d3-6117-406b-9b1b-b01206f04063 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33/users/cf9d84554d9c4cf2a39183e67800c82b/roles/88c41930377947b7a1dc0134ba0f787b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:01.073297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364596d3-6117-406b-9b1b-b01206f04063 None admin] RBAC: Authorizing `identity:create_grant(project_id=903a0b97a2f547ba915abf85091b8d33, user_id=cf9d84554d9c4cf2a39183e67800c82b, role_id=88c41930377947b7a1dc0134ba0f787b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:01.074591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364596d3-6117-406b-9b1b-b01206f04063 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:01.087803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 54/119] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:00:00 2022] PUT /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33/users/cf9d84554d9c4cf2a39183e67800c82b/roles/88c41930377947b7a1dc0134ba0f787b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:01.089102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da99e2a-ddbb-41e6-8844-220377a44738 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:01.089399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da99e2a-ddbb-41e6-8844-220377a44738 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:01.089689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da99e2a-ddbb-41e6-8844-220377a44738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:01.108788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2da99e2a-ddbb-41e6-8844-220377a44738 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:01.110188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2da99e2a-ddbb-41e6-8844-220377a44738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:01.160844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:01.175415 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5a949-b399-4c4b-8254-ac5a06cee220 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:01.187921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 55/120] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:01.187921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da99e2a-ddbb-41e6-8844-220377a44738 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:01.229980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c0620-b327-4179-a6b5-8b873d9cd190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:01.230677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c0620-b327-4179-a6b5-8b873d9cd190 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:01.230972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c0620-b327-4179-a6b5-8b873d9cd190 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:01.231266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c0620-b327-4179-a6b5-8b873d9cd190 None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:01.232054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c0620-b327-4179-a6b5-8b873d9cd190 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:01.233562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c0620-b327-4179-a6b5-8b873d9cd190 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:01.263817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 66/121] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 15:00:01 2022] POST /identity/v3/projects => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:01.264984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8231f-1115-4263-b201-4a075a5e613e None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:01.265285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8231f-1115-4263-b201-4a075a5e613e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:01.265841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8231f-1115-4263-b201-4a075a5e613e None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:01.267088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 67/122] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:01.270195 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8231f-1115-4263-b201-4a075a5e613e None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:01.288080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:01.333420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da99e2a-ddbb-41e6-8844-220377a44738 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:01.380205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e8d6-d043-4276-b04b-1d7f58bd909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:01.380988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e8d6-d043-4276-b04b-1d7f58bd909a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:01.381346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e8d6-d043-4276-b04b-1d7f58bd909a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:01.381719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e8d6-d043-4276-b04b-1d7f58bd909a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:01.382863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e8d6-d043-4276-b04b-1d7f58bd909a None admin] RBAC: Adding query filter params (role.id=5cd390b79218462b9837d41be8ec8b5c, scope.project.id=903a0b97a2f547ba915abf85091b8d33, user.id=e404761da2934fe3a03e6c59ab6d6621) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:01.383385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e8d6-d043-4276-b04b-1d7f58bd909a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:01.385056 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e8d6-d043-4276-b04b-1d7f58bd909a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:01.392037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 56/123] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:01 2022] GET /identity/v3/role_assignments?user.id=e404761da2934fe3a03e6c59ab6d6621&scope.project.id=903a0b97a2f547ba915abf85091b8d33&role.id=5cd390b79218462b9837d41be8ec8b5c => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:01.392829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e8d6-d043-4276-b04b-1d7f58bd909a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:01.425905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8231f-1115-4263-b201-4a075a5e613e None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:01.469741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03a42e-137f-4a6a-b79b-c3b2985e17f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:01.470410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03a42e-137f-4a6a-b79b-c3b2985e17f7 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:01.470410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03a42e-137f-4a6a-b79b-c3b2985e17f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:01.470554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03a42e-137f-4a6a-b79b-c3b2985e17f7 None admin] PATH_INFO: `/v3/users/ad3666eef9be46b0b4707636932d0a11` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:01.472185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03a42e-137f-4a6a-b79b-c3b2985e17f7 None admin] RBAC: Authorizing `identity:get_user(user_id=ad3666eef9be46b0b4707636932d0a11)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:01.473959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03a42e-137f-4a6a-b79b-c3b2985e17f7 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:01.476479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 68/124] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:01 2022] GET /identity/v3/users/ad3666eef9be46b0b4707636932d0a11 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:01.477856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaac477-3ad4-420e-a507-b9aecbfa10b5 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:01.478222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaac477-3ad4-420e-a507-b9aecbfa10b5 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:01.478616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaac477-3ad4-420e-a507-b9aecbfa10b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:01.499144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-fcaac477-3ad4-420e-a507-b9aecbfa10b5 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:01.500009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-fcaac477-3ad4-420e-a507-b9aecbfa10b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:01.511298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:01.588456 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 69/125] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:01.590381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaac477-3ad4-420e-a507-b9aecbfa10b5 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:01.599597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e8d6-d043-4276-b04b-1d7f58bd909a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:01.609423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:01.649822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d5a2f-9443-45fb-8b15-d2140eaf41aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:01.650756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d5a2f-9443-45fb-8b15-d2140eaf41aa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:01.651046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d5a2f-9443-45fb-8b15-d2140eaf41aa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:01.651325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d5a2f-9443-45fb-8b15-d2140eaf41aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:01.663475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d5a2f-9443-45fb-8b15-d2140eaf41aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c11d5a2f-9443-45fb-8b15-d2140eaf41aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:01.672240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:01.673157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:01.673921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 57/126] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:00:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:01.674632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d5a2f-9443-45fb-8b15-d2140eaf41aa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:01.732656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaac477-3ad4-420e-a507-b9aecbfa10b5 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:01.772823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19513032-5bba-4b60-8301-27e5a0aceebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:01.774055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19513032-5bba-4b60-8301-27e5a0aceebb None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:01.774728 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19513032-5bba-4b60-8301-27e5a0aceebb None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:01.775247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19513032-5bba-4b60-8301-27e5a0aceebb None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:01.776729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19513032-5bba-4b60-8301-27e5a0aceebb None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:01.778545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19513032-5bba-4b60-8301-27e5a0aceebb None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:01.780518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 70/127] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:01 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:01.782268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19513032-5bba-4b60-8301-27e5a0aceebb None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:01.853886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d5a2f-9443-45fb-8b15-d2140eaf41aa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:01.855670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:01.880317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:01.901059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19513032-5bba-4b60-8301-27e5a0aceebb None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:01.920407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335034d-aabd-41b8-8c3a-49c2671052ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:01.921724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335034d-aabd-41b8-8c3a-49c2671052ec None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:01.922171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335034d-aabd-41b8-8c3a-49c2671052ec None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:01.922717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335034d-aabd-41b8-8c3a-49c2671052ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:01.935872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335034d-aabd-41b8-8c3a-49c2671052ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:01.942047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6918144-1f52-4718-873f-eb6cb04e9cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:01.942838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6918144-1f52-4718-873f-eb6cb04e9cde None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:01.943227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6918144-1f52-4718-873f-eb6cb04e9cde None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:01.943654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6918144-1f52-4718-873f-eb6cb04e9cde None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:01.944531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6918144-1f52-4718-873f-eb6cb04e9cde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:01.944937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6918144-1f52-4718-873f-eb6cb04e9cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-1335034d-aabd-41b8-8c3a-49c2671052ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:01.945662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:01.946680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:01.947470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:01.947470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:01.947470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:01.947470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:01.947470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:01.947470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:01.947470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:01.947470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:01.947470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:01.947470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:01.947470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:01.947470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:01.948091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6918144-1f52-4718-873f-eb6cb04e9cde None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:01.950468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 58/128] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:01.951488 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335034d-aabd-41b8-8c3a-49c2671052ec None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:01.961081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 71/129] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:01.961081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6918144-1f52-4718-873f-eb6cb04e9cde None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:02.097003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335034d-aabd-41b8-8c3a-49c2671052ec None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:02.119360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6918144-1f52-4718-873f-eb6cb04e9cde None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:02.134083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21379269-b0f0-435f-806f-4f92d28d044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:02.134998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21379269-b0f0-435f-806f-4f92d28d044e None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:02.135292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21379269-b0f0-435f-806f-4f92d28d044e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:02.135590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21379269-b0f0-435f-806f-4f92d28d044e None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33/users/ad3666eef9be46b0b4707636932d0a11/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:02.139499 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21379269-b0f0-435f-806f-4f92d28d044e None admin] RBAC: Authorizing `identity:create_grant(project_id=903a0b97a2f547ba915abf85091b8d33, user_id=ad3666eef9be46b0b4707636932d0a11, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:02.140991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21379269-b0f0-435f-806f-4f92d28d044e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:02.170837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 59/130] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:00:01 2022] PUT /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33/users/ad3666eef9be46b0b4707636932d0a11/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:02.172678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21379269-b0f0-435f-806f-4f92d28d044e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:02.181958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb68e5f-96eb-469a-94e0-7e240b684d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:02.182662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb68e5f-96eb-469a-94e0-7e240b684d35 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:02.182958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb68e5f-96eb-469a-94e0-7e240b684d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:02.183244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb68e5f-96eb-469a-94e0-7e240b684d35 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:02.188252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb68e5f-96eb-469a-94e0-7e240b684d35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:02.188588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb68e5f-96eb-469a-94e0-7e240b684d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:02.190013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb68e5f-96eb-469a-94e0-7e240b684d35 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:02.202314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:02.210347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 72/131] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:02.216989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb68e5f-96eb-469a-94e0-7e240b684d35 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:02.227377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:02.360835 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21379269-b0f0-435f-806f-4f92d28d044e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:02.404446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb68e5f-96eb-469a-94e0-7e240b684d35 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:02.425245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4f65-da7e-461d-9eb7-f934dc71a80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:02.426423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4f65-da7e-461d-9eb7-f934dc71a80c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:02.426870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4f65-da7e-461d-9eb7-f934dc71a80c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:02.427404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4f65-da7e-461d-9eb7-f934dc71a80c None admin] PATH_INFO: `/v3/users/cf9d84554d9c4cf2a39183e67800c82b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:02.433239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d4f65-da7e-461d-9eb7-f934dc71a80c None admin] RBAC: Authorizing `identity:get_user(user_id=cf9d84554d9c4cf2a39183e67800c82b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:02.435131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d4f65-da7e-461d-9eb7-f934dc71a80c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:02.437257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 60/132] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:02 2022] GET /identity/v3/users/cf9d84554d9c4cf2a39183e67800c82b => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:02.448391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4f65-da7e-461d-9eb7-f934dc71a80c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:02.450557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997207d-7d69-4234-a31b-a9b3e6dadf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:02.451552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997207d-7d69-4234-a31b-a9b3e6dadf98 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:02.451965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997207d-7d69-4234-a31b-a9b3e6dadf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:02.452403 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997207d-7d69-4234-a31b-a9b3e6dadf98 None admin] PATH_INFO: `/v3/users/cf9d84554d9c4cf2a39183e67800c82b` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:02.455614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997207d-7d69-4234-a31b-a9b3e6dadf98 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9d84554d9c4cf2a39183e67800c82b)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:02.455614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997207d-7d69-4234-a31b-a9b3e6dadf98 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:02.458761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 73/133] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:02 2022] GET /identity/v3/users/cf9d84554d9c4cf2a39183e67800c82b => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:02.465088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997207d-7d69-4234-a31b-a9b3e6dadf98 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:02.554913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:02.592526 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997207d-7d69-4234-a31b-a9b3e6dadf98 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:02.629416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7f2ec-d4b8-4ff9-8240-4a736d102c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:02.630832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7f2ec-d4b8-4ff9-8240-4a736d102c18 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:02.631212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7f2ec-d4b8-4ff9-8240-4a736d102c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:02.631602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7f2ec-d4b8-4ff9-8240-4a736d102c18 None admin] PATH_INFO: `/v3/projects/4a71790f77a34a0eb614716223b07504` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:02.633276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7f2ec-d4b8-4ff9-8240-4a736d102c18 None admin] RBAC: Authorizing `identity:get_project(project_id=4a71790f77a34a0eb614716223b07504)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:02.635057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7f2ec-d4b8-4ff9-8240-4a736d102c18 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:02.637061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 74/134] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:02 2022] GET /identity/v3/projects/4a71790f77a34a0eb614716223b07504 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:02.643831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7f2ec-d4b8-4ff9-8240-4a736d102c18 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:02.664928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:02.713659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4f65-da7e-461d-9eb7-f934dc71a80c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:02.752145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7f2ec-d4b8-4ff9-8240-4a736d102c18 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:02.796529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba45cf-c768-40f8-b177-5ebb630b0b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:02.797448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba45cf-c768-40f8-b177-5ebb630b0b67 None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:02.797732 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba45cf-c768-40f8-b177-5ebb630b0b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:02.798011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba45cf-c768-40f8-b177-5ebb630b0b67 None admin] PATH_INFO: `/v3/projects/4a71790f77a34a0eb614716223b07504/users/cf9d84554d9c4cf2a39183e67800c82b/roles/88c41930377947b7a1dc0134ba0f787b` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:02.802357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba45cf-c768-40f8-b177-5ebb630b0b67 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a71790f77a34a0eb614716223b07504, user_id=cf9d84554d9c4cf2a39183e67800c82b, role_id=88c41930377947b7a1dc0134ba0f787b)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:02.803882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba45cf-c768-40f8-b177-5ebb630b0b67 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:02.811925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:02.829898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a17d1f-6beb-4d1c-b1b8-27715daff7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:02.830801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a17d1f-6beb-4d1c-b1b8-27715daff7dc None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:02.831140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a17d1f-6beb-4d1c-b1b8-27715daff7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:02.831436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a17d1f-6beb-4d1c-b1b8-27715daff7dc None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:02.834294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 75/135] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:00:02 2022] PUT /identity/v3/projects/4a71790f77a34a0eb614716223b07504/users/cf9d84554d9c4cf2a39183e67800c82b/roles/88c41930377947b7a1dc0134ba0f787b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:02.836346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a17d1f-6beb-4d1c-b1b8-27715daff7dc None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:02.838263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a17d1f-6beb-4d1c-b1b8-27715daff7dc None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:02.840353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 61/136] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:02 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:02.845791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba45cf-c768-40f8-b177-5ebb630b0b67 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:03.017003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba45cf-c768-40f8-b177-5ebb630b0b67 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:03.066644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2ae25-d321-4516-b529-622b587e337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:03.067588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2ae25-d321-4516-b529-622b587e337c None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:03.067863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2ae25-d321-4516-b529-622b587e337c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:03.068139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2ae25-d321-4516-b529-622b587e337c None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33/users/cf9d84554d9c4cf2a39183e67800c82b/roles/47a961686ccc4c6a8bb05e0f3fe5ffba` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:03.073598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2ae25-d321-4516-b529-622b587e337c None admin] RBAC: Authorizing `identity:create_grant(project_id=903a0b97a2f547ba915abf85091b8d33, user_id=cf9d84554d9c4cf2a39183e67800c82b, role_id=47a961686ccc4c6a8bb05e0f3fe5ffba)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:03.075110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2ae25-d321-4516-b529-622b587e337c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:03.098564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 76/137] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:00:02 2022] PUT /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33/users/cf9d84554d9c4cf2a39183e67800c82b/roles/47a961686ccc4c6a8bb05e0f3fe5ffba => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:04.009728 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d2717-3218-458b-8184-ab40139d9894 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:04.010249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d2717-3218-458b-8184-ab40139d9894 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:04.010353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d2717-3218-458b-8184-ab40139d9894 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:04.011678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 62/138] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:04.023749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af2091-81ba-4edf-8254-705bcc8b73e3 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:04.024214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af2091-81ba-4edf-8254-705bcc8b73e3 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:04.024285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af2091-81ba-4edf-8254-705bcc8b73e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:04.044584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-83af2091-81ba-4edf-8254-705bcc8b73e3 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:04.045771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-83af2091-81ba-4edf-8254-705bcc8b73e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:04.107383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:04.133467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 77/139] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:04.173292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d2717-3218-458b-8184-ab40139d9894 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:04.283457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d2717-3218-458b-8184-ab40139d9894 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:04.319872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efa5a4-5eb4-458d-999c-1933d68c298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:04.320700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efa5a4-5eb4-458d-999c-1933d68c298f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:04.320985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efa5a4-5eb4-458d-999c-1933d68c298f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:04.321264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efa5a4-5eb4-458d-999c-1933d68c298f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:04.332007 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efa5a4-5eb4-458d-999c-1933d68c298f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-58efa5a4-5eb4-458d-999c-1933d68c298f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:04.339975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:04.341060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:04.342041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:04.342041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:04.342041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:04.342041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:04.342041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:04.342041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:04.342041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:04.342041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:04.342041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:04.342041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:04.342041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:04.342041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:04.344351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 63/140] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:04.350412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af2091-81ba-4edf-8254-705bcc8b73e3 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:04.461170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af2091-81ba-4edf-8254-705bcc8b73e3 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:04.502457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f2023-311b-4c65-9b61-32a935fbcb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:04.503582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f2023-311b-4c65-9b61-32a935fbcb40 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:04.503871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f2023-311b-4c65-9b61-32a935fbcb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:04.504144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f2023-311b-4c65-9b61-32a935fbcb40 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:04.504915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f2023-311b-4c65-9b61-32a935fbcb40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:04.505220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f2023-311b-4c65-9b61-32a935fbcb40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:04.506691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f2023-311b-4c65-9b61-32a935fbcb40 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:04.515338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 78/141] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:04.520824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efa5a4-5eb4-458d-999c-1933d68c298f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:04.541113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:04.557835 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2a586-79c6-4edd-ae98-ab02702c313a None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:04.558113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2a586-79c6-4edd-ae98-ab02702c313a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:04.558432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2a586-79c6-4edd-ae98-ab02702c313a None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:04.559921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 79/142] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:04.560983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095585b5-78e0-4366-9477-1e9c1607f8c5 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:04.561260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095585b5-78e0-4366-9477-1e9c1607f8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:04.561605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095585b5-78e0-4366-9477-1e9c1607f8c5 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:04.562727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 80/143] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:04.569133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c4c67-037c-4ed7-8421-30ad37601da4 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:04.569419 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c4c67-037c-4ed7-8421-30ad37601da4 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:04.569696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c4c67-037c-4ed7-8421-30ad37601da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:04.600591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-2f3c4c67-037c-4ed7-8421-30ad37601da4 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:04.601802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-2f3c4c67-037c-4ed7-8421-30ad37601da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:04.638862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efa5a4-5eb4-458d-999c-1933d68c298f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:04.673657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abd292-76cc-4510-9c58-f1dddf40ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:04.674558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abd292-76cc-4510-9c58-f1dddf40ce60 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:04.674845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abd292-76cc-4510-9c58-f1dddf40ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:04.675122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abd292-76cc-4510-9c58-f1dddf40ce60 None admin] PATH_INFO: `/v3/users/cf9d84554d9c4cf2a39183e67800c82b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:04.676710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abd292-76cc-4510-9c58-f1dddf40ce60 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9d84554d9c4cf2a39183e67800c82b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:04.678316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abd292-76cc-4510-9c58-f1dddf40ce60 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:04.680434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 64/144] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:04 2022] GET /identity/v3/users/cf9d84554d9c4cf2a39183e67800c82b => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:04.681629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9751155-80dc-4146-8024-61c2fa1ae6f7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:04.681919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9751155-80dc-4146-8024-61c2fa1ae6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:04.682197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9751155-80dc-4146-8024-61c2fa1ae6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:04.704248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c9751155-80dc-4146-8024-61c2fa1ae6f7 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:04.705433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c9751155-80dc-4146-8024-61c2fa1ae6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:04.754381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:04.778451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 65/145] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:04.778846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9751155-80dc-4146-8024-61c2fa1ae6f7 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:04.805706 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:04.833983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 81/146] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:04.835023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c4c67-037c-4ed7-8421-30ad37601da4 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:04.882762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9751155-80dc-4146-8024-61c2fa1ae6f7 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:04.916886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e7225-402f-4ba9-8e14-6e096d3150fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:04.917853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e7225-402f-4ba9-8e14-6e096d3150fe None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:04.918310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e7225-402f-4ba9-8e14-6e096d3150fe None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:04.918775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e7225-402f-4ba9-8e14-6e096d3150fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:04.988407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c4c67-037c-4ed7-8421-30ad37601da4 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:05.051710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794c963-4ef9-43fd-9682-b23e9bc6012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:05.052709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c963-4ef9-43fd-9682-b23e9bc6012c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:05.052995 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c963-4ef9-43fd-9682-b23e9bc6012c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:05.053320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c963-4ef9-43fd-9682-b23e9bc6012c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:05.054997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794c963-4ef9-43fd-9682-b23e9bc6012c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:05.056911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794c963-4ef9-43fd-9682-b23e9bc6012c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:05.058771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 82/147] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:05.059581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794c963-4ef9-43fd-9682-b23e9bc6012c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:05.074257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e7225-402f-4ba9-8e14-6e096d3150fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:05.076490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e7225-402f-4ba9-8e14-6e096d3150fe None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:05.107822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:05.115015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:05.167545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794c963-4ef9-43fd-9682-b23e9bc6012c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:05.203591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e268e0-ac42-4fe2-9c72-5098afea1521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:05.204405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e268e0-ac42-4fe2-9c72-5098afea1521 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:05.204742 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e268e0-ac42-4fe2-9c72-5098afea1521 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:05.205155 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e268e0-ac42-4fe2-9c72-5098afea1521 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:05.220117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e268e0-ac42-4fe2-9c72-5098afea1521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-01e268e0-ac42-4fe2-9c72-5098afea1521 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:05.229089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:05.230287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:05.231062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 83/148] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:05.231739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e268e0-ac42-4fe2-9c72-5098afea1521 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:05.296321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 66/149] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:05.297591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e7225-402f-4ba9-8e14-6e096d3150fe None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:05.332543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e268e0-ac42-4fe2-9c72-5098afea1521 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:05.339619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:05.368784 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b7fe8-f4f2-4f3d-80c1-56872b4ffed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:05.369515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b7fe8-f4f2-4f3d-80c1-56872b4ffed4 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:05.369801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b7fe8-f4f2-4f3d-80c1-56872b4ffed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:05.370077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b7fe8-f4f2-4f3d-80c1-56872b4ffed4 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:05.370851 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b7fe8-f4f2-4f3d-80c1-56872b4ffed4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:05.373071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b7fe8-f4f2-4f3d-80c1-56872b4ffed4 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:05.399691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 84/150] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:00:05 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:05.405485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e8d51-83c9-4c02-b92d-f804932017ba None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:05.405485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e8d51-83c9-4c02-b92d-f804932017ba None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:05.405485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e8d51-83c9-4c02-b92d-f804932017ba None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:05.405485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 85/151] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:05.405485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e8d51-83c9-4c02-b92d-f804932017ba None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:05.432689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e7225-402f-4ba9-8e14-6e096d3150fe None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:05.469489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:05.513212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4382a-0d56-4541-b0c6-73b0cd0e0f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:05.514086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4382a-0d56-4541-b0c6-73b0cd0e0f9c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:05.514381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4382a-0d56-4541-b0c6-73b0cd0e0f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:05.514660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4382a-0d56-4541-b0c6-73b0cd0e0f9c None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:05.515432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4382a-0d56-4541-b0c6-73b0cd0e0f9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:05.515767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4382a-0d56-4541-b0c6-73b0cd0e0f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:05.517302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4382a-0d56-4541-b0c6-73b0cd0e0f9c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:05.531414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e8d51-83c9-4c02-b92d-f804932017ba None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:05.536236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 67/152] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:05.537708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7903d74-59c3-478d-a4d9-64087b7e478f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:05.538007 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7903d74-59c3-478d-a4d9-64087b7e478f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:05.538377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7903d74-59c3-478d-a4d9-64087b7e478f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:05.570748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4a608-304d-4a77-b473-ffbeb5162dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:05.571259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d7903d74-59c3-478d-a4d9-64087b7e478f None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:05.571666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4a608-304d-4a77-b473-ffbeb5162dad None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:05.571949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4a608-304d-4a77-b473-ffbeb5162dad None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:05.572224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4a608-304d-4a77-b473-ffbeb5162dad None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:05.572518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d7903d74-59c3-478d-a4d9-64087b7e478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:05.573720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4a608-304d-4a77-b473-ffbeb5162dad None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:05.575722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4a608-304d-4a77-b473-ffbeb5162dad None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:05.578697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 86/153] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:05 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:05.579595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4a608-304d-4a77-b473-ffbeb5162dad None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:05.644047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:05.647074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 68/154] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:05.648284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7903d74-59c3-478d-a4d9-64087b7e478f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:05.710130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4a608-304d-4a77-b473-ffbeb5162dad None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:05.749816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871f748-7faf-4208-8c35-ef7964872e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:05.750800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871f748-7faf-4208-8c35-ef7964872e38 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:05.751084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871f748-7faf-4208-8c35-ef7964872e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:05.751450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871f748-7faf-4208-8c35-ef7964872e38 None admin] PATH_INFO: `/v3/users/e404761da2934fe3a03e6c59ab6d6621` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:05.752688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871f748-7faf-4208-8c35-ef7964872e38 None admin] RBAC: Authorizing `identity:get_user(user_id=e404761da2934fe3a03e6c59ab6d6621)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:05.754339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871f748-7faf-4208-8c35-ef7964872e38 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:05.756317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 87/155] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:05 2022] GET /identity/v3/users/e404761da2934fe3a03e6c59ab6d6621 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:05.756900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871f748-7faf-4208-8c35-ef7964872e38 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:05.802611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7903d74-59c3-478d-a4d9-64087b7e478f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:05.815170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:05.844236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83685af1-776f-400c-ae6d-43ca0a87ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:05.845358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83685af1-776f-400c-ae6d-43ca0a87ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:05.845793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83685af1-776f-400c-ae6d-43ca0a87ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:05.846207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83685af1-776f-400c-ae6d-43ca0a87ffc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:05.847071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83685af1-776f-400c-ae6d-43ca0a87ffc6 None admin] RBAC: Adding query filter params (role.id=88c41930377947b7a1dc0134ba0f787b, scope.project.id=903a0b97a2f547ba915abf85091b8d33, user.id=cf9d84554d9c4cf2a39183e67800c82b) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:05.847386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83685af1-776f-400c-ae6d-43ca0a87ffc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:05.848890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83685af1-776f-400c-ae6d-43ca0a87ffc6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:05.860321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 69/156] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:05 2022] GET /identity/v3/role_assignments?user.id=cf9d84554d9c4cf2a39183e67800c82b&scope.project.id=903a0b97a2f547ba915abf85091b8d33&role.id=88c41930377947b7a1dc0134ba0f787b => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:05.865449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83685af1-776f-400c-ae6d-43ca0a87ffc6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:05.919311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:05.928008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871f748-7faf-4208-8c35-ef7964872e38 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:06.004027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eae1f-32d6-4b49-b961-b3588a0832e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:06.006595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eae1f-32d6-4b49-b961-b3588a0832e3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.007999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eae1f-32d6-4b49-b961-b3588a0832e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.008508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eae1f-32d6-4b49-b961-b3588a0832e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:06.036567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eae1f-32d6-4b49-b961-b3588a0832e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-144eae1f-32d6-4b49-b961-b3588a0832e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:06.051823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:06.053181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:06.054040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:06.054040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:06.054040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:06.054040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:06.054040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:06.054040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:06.054040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:06.054040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:06.054040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:06.054040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:06.054040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:06.054040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:06.061668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 88/157] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:00:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:06.067208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eae1f-32d6-4b49-b961-b3588a0832e3 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:06.095916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83685af1-776f-400c-ae6d-43ca0a87ffc6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:06.149285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23766dea-a04a-4462-b046-860e56c3666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:06.150528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766dea-a04a-4462-b046-860e56c3666d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.151003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766dea-a04a-4462-b046-860e56c3666d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.151494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766dea-a04a-4462-b046-860e56c3666d None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:06.153699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23766dea-a04a-4462-b046-860e56c3666d None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:06.155514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23766dea-a04a-4462-b046-860e56c3666d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:06.157797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 70/158] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:05 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:06.159259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bffc1-1a62-45db-a249-0307cab3333b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.160330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bffc1-1a62-45db-a249-0307cab3333b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.160797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bffc1-1a62-45db-a249-0307cab3333b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:06.162262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 71/159] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:06.163126 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bffc1-1a62-45db-a249-0307cab3333b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:06.233357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:06.245106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eae1f-32d6-4b49-b961-b3588a0832e3 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:06.297738 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442bc7d-d765-42d2-9413-e41593de270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:06.298436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442bc7d-d765-42d2-9413-e41593de270a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.298730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442bc7d-d765-42d2-9413-e41593de270a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.299171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442bc7d-d765-42d2-9413-e41593de270a None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:06.300092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442bc7d-d765-42d2-9413-e41593de270a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:06.300404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442bc7d-d765-42d2-9413-e41593de270a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:06.302415 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442bc7d-d765-42d2-9413-e41593de270a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:06.315766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bffc1-1a62-45db-a249-0307cab3333b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:06.317248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 89/160] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:06.319778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a88ab-7d63-4256-9235-c64eeb27e658 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.319778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a88ab-7d63-4256-9235-c64eeb27e658 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.319778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a88ab-7d63-4256-9235-c64eeb27e658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:06.344444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-846a88ab-7d63-4256-9235-c64eeb27e658 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:06.346959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-846a88ab-7d63-4256-9235-c64eeb27e658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:06.363199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef0ef6-abd2-4c2e-99f6-c36530ca475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:06.364458 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef0ef6-abd2-4c2e-99f6-c36530ca475d None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.364749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef0ef6-abd2-4c2e-99f6-c36530ca475d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.365031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef0ef6-abd2-4c2e-99f6-c36530ca475d None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33/users/e404761da2934fe3a03e6c59ab6d6621/roles/5cd390b79218462b9837d41be8ec8b5c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:06.368736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:06.369200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef0ef6-abd2-4c2e-99f6-c36530ca475d None admin] RBAC: Authorizing `identity:create_grant(project_id=903a0b97a2f547ba915abf85091b8d33, user_id=e404761da2934fe3a03e6c59ab6d6621, role_id=5cd390b79218462b9837d41be8ec8b5c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:06.371256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef0ef6-abd2-4c2e-99f6-c36530ca475d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:06.388577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 72/161] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:00:06 2022] PUT /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33/users/e404761da2934fe3a03e6c59ab6d6621/roles/5cd390b79218462b9837d41be8ec8b5c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:06.389400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef0ef6-abd2-4c2e-99f6-c36530ca475d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:06.456294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 90/162] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:06.458132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4690d7-2da2-4f27-9d6a-83c007549253 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.458604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4690d7-2da2-4f27-9d6a-83c007549253 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.459077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4690d7-2da2-4f27-9d6a-83c007549253 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:06.460804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 91/163] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:06.467466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46d6dc-60f2-41e7-a411-2fb2d167ea1a None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.469595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46d6dc-60f2-41e7-a411-2fb2d167ea1a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.470190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46d6dc-60f2-41e7-a411-2fb2d167ea1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:06.495319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-ab46d6dc-60f2-41e7-a411-2fb2d167ea1a None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:06.497330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-ab46d6dc-60f2-41e7-a411-2fb2d167ea1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:06.546124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:06.551961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef0ef6-abd2-4c2e-99f6-c36530ca475d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:06.590262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 92/164] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:06.591761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46d6dc-60f2-41e7-a411-2fb2d167ea1a None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:06.611654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7371d-1bea-4b9e-ac6d-2668c32a96bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:06.612852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7371d-1bea-4b9e-ac6d-2668c32a96bd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.613270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7371d-1bea-4b9e-ac6d-2668c32a96bd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.613677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7371d-1bea-4b9e-ac6d-2668c32a96bd None admin] PATH_INFO: `/v3/users/ad3666eef9be46b0b4707636932d0a11` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:06.615987 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7371d-1bea-4b9e-ac6d-2668c32a96bd None admin] RBAC: Authorizing `identity:get_user(user_id=ad3666eef9be46b0b4707636932d0a11)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:06.617856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7371d-1bea-4b9e-ac6d-2668c32a96bd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:06.619856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 73/165] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:06 2022] GET /identity/v3/users/ad3666eef9be46b0b4707636932d0a11 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:06.624418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7371d-1bea-4b9e-ac6d-2668c32a96bd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:06.715944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:06.751607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46d6dc-60f2-41e7-a411-2fb2d167ea1a None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:06.753092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7371d-1bea-4b9e-ac6d-2668c32a96bd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:06.795895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ca068-db08-4686-a196-a48d828a82a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:06.797913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ca068-db08-4686-a196-a48d828a82a8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.798245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ca068-db08-4686-a196-a48d828a82a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.798585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ca068-db08-4686-a196-a48d828a82a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:06.810447 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ca068-db08-4686-a196-a48d828a82a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-cd4ca068-db08-4686-a196-a48d828a82a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:06.819494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:06.820425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:06.821246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 74/166] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:00:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:06.822126 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ca068-db08-4686-a196-a48d828a82a8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:06.840739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833a256-5556-4861-954f-d8101a9401a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:06.841579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833a256-5556-4861-954f-d8101a9401a7 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.841864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833a256-5556-4861-954f-d8101a9401a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.842139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833a256-5556-4861-954f-d8101a9401a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:06.857884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:06.866641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833a256-5556-4861-954f-d8101a9401a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-6833a256-5556-4861-954f-d8101a9401a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:06.874627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:06.877062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:06.879303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:06.879303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:06.879303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:06.879303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:06.879303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:06.879303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:06.879303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:06.879303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:06.879303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:06.879303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:06.879303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:06.879303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:06.887589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 93/167] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:06.887589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833a256-5556-4861-954f-d8101a9401a7 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:06.940661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ca068-db08-4686-a196-a48d828a82a8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:06.977335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910f8b8-7449-4839-bd04-f8cd97113371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:06.978000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910f8b8-7449-4839-bd04-f8cd97113371 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:06.978283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910f8b8-7449-4839-bd04-f8cd97113371 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:06.978614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910f8b8-7449-4839-bd04-f8cd97113371 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.049292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910f8b8-7449-4839-bd04-f8cd97113371 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:07.050845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910f8b8-7449-4839-bd04-f8cd97113371 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:07.081601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:07.159138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 75/168] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:07.160446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910f8b8-7449-4839-bd04-f8cd97113371 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:07.174516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833a256-5556-4861-954f-d8101a9401a7 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:07.243377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0b79f-57ee-466b-9f9e-7c9fa8177470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:07.244363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0b79f-57ee-466b-9f9e-7c9fa8177470 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:07.244813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0b79f-57ee-466b-9f9e-7c9fa8177470 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:07.245232 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0b79f-57ee-466b-9f9e-7c9fa8177470 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.246139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0b79f-57ee-466b-9f9e-7c9fa8177470 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:07.246587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0b79f-57ee-466b-9f9e-7c9fa8177470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:07.248160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0b79f-57ee-466b-9f9e-7c9fa8177470 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:07.269424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 94/169] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:07.271708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0b79f-57ee-466b-9f9e-7c9fa8177470 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:07.277682 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:07.315863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910f8b8-7449-4839-bd04-f8cd97113371 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:07.392552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:07.409255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d39cf-3230-4b08-851c-daf1a9048da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:07.409952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d39cf-3230-4b08-851c-daf1a9048da1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:07.410239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d39cf-3230-4b08-851c-daf1a9048da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:07.410517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d39cf-3230-4b08-851c-daf1a9048da1 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.411287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d39cf-3230-4b08-851c-daf1a9048da1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:07.411618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d39cf-3230-4b08-851c-daf1a9048da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:07.413011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d39cf-3230-4b08-851c-daf1a9048da1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:07.427235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 76/170] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:07.428115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d39cf-3230-4b08-851c-daf1a9048da1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:07.507639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0b79f-57ee-466b-9f9e-7c9fa8177470 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:07.586553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c106f4-dd02-4e9d-a57d-cfb6b252583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:07.587383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c106f4-dd02-4e9d-a57d-cfb6b252583b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:07.587704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c106f4-dd02-4e9d-a57d-cfb6b252583b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:07.587977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c106f4-dd02-4e9d-a57d-cfb6b252583b None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.589353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c106f4-dd02-4e9d-a57d-cfb6b252583b None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:07.590828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c106f4-dd02-4e9d-a57d-cfb6b252583b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:07.600413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 95/171] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:07 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:07.603294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c106f4-dd02-4e9d-a57d-cfb6b252583b None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:07.613747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d39cf-3230-4b08-851c-daf1a9048da1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:07.654659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb73e7-d210-41cb-97e7-d1b4c1007667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:07.655557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb73e7-d210-41cb-97e7-d1b4c1007667 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:07.655868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb73e7-d210-41cb-97e7-d1b4c1007667 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:07.656149 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb73e7-d210-41cb-97e7-d1b4c1007667 None admin] PATH_INFO: `/v3/users/cf9d84554d9c4cf2a39183e67800c82b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.657885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb73e7-d210-41cb-97e7-d1b4c1007667 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9d84554d9c4cf2a39183e67800c82b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:07.659331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb73e7-d210-41cb-97e7-d1b4c1007667 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:07.661624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 77/172] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:07 2022] GET /identity/v3/users/cf9d84554d9c4cf2a39183e67800c82b => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:07.662574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb73e7-d210-41cb-97e7-d1b4c1007667 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:07.741448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:07.780058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c106f4-dd02-4e9d-a57d-cfb6b252583b None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:07.783647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:07.826736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f49f8-9077-4258-92d4-b1ae3c003e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:07.827676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f49f8-9077-4258-92d4-b1ae3c003e3d None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:07.827964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f49f8-9077-4258-92d4-b1ae3c003e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:07.828243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f49f8-9077-4258-92d4-b1ae3c003e3d None admin] PATH_INFO: `/v3/users/cf9d84554d9c4cf2a39183e67800c82b` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.832321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f49f8-9077-4258-92d4-b1ae3c003e3d None admin] RBAC: Authorizing `identity:get_user(user_id=cf9d84554d9c4cf2a39183e67800c82b)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:07.833829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f49f8-9077-4258-92d4-b1ae3c003e3d None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:07.835530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 96/173] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:07 2022] GET /identity/v3/users/cf9d84554d9c4cf2a39183e67800c82b => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:07.836349 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f49f8-9077-4258-92d4-b1ae3c003e3d None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:07.868842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb73e7-d210-41cb-97e7-d1b4c1007667 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:07.933119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee9193-e0cb-4238-a4ff-f0928b8e2a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:07.933852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee9193-e0cb-4238-a4ff-f0928b8e2a33 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:07.934141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee9193-e0cb-4238-a4ff-f0928b8e2a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:07.934420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee9193-e0cb-4238-a4ff-f0928b8e2a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:07.935275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee9193-e0cb-4238-a4ff-f0928b8e2a33 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=903a0b97a2f547ba915abf85091b8d33, user.id=ad3666eef9be46b0b4707636932d0a11) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:07.935603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee9193-e0cb-4238-a4ff-f0928b8e2a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:07.937133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee9193-e0cb-4238-a4ff-f0928b8e2a33 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:07.947916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 78/174] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:07 2022] GET /identity/v3/role_assignments?user.id=ad3666eef9be46b0b4707636932d0a11&scope.project.id=903a0b97a2f547ba915abf85091b8d33&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:07.948864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee9193-e0cb-4238-a4ff-f0928b8e2a33 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.018609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f49f8-9077-4258-92d4-b1ae3c003e3d None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.073394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee9193-e0cb-4238-a4ff-f0928b8e2a33 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.088505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a09277-4267-492a-be38-066a406e3f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.089207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a09277-4267-492a-be38-066a406e3f43 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.089496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a09277-4267-492a-be38-066a406e3f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.089776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a09277-4267-492a-be38-066a406e3f43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.099959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:08.109633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:08.112214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fcce8-619f-49ca-ab1c-6907b2ff9162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.113200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fcce8-619f-49ca-ab1c-6907b2ff9162 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.113675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fcce8-619f-49ca-ab1c-6907b2ff9162 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.114165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fcce8-619f-49ca-ab1c-6907b2ff9162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.213215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fcce8-619f-49ca-ab1c-6907b2ff9162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.221918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fcce8-619f-49ca-ab1c-6907b2ff9162 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.305873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a09277-4267-492a-be38-066a406e3f43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.310599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a09277-4267-492a-be38-066a406e3f43 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.417506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 79/175] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:08.424614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fcce8-619f-49ca-ab1c-6907b2ff9162 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.469148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:08.489987 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 97/176] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:08.514755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a09277-4267-492a-be38-066a406e3f43 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.563467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fcce8-619f-49ca-ab1c-6907b2ff9162 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.575704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:08.602209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0177-b242-4e20-b2e8-4621b42c75be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.603093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0177-b242-4e20-b2e8-4621b42c75be None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.603380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0177-b242-4e20-b2e8-4621b42c75be None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.603685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0177-b242-4e20-b2e8-4621b42c75be None admin] PATH_INFO: `/v3/projects/4a71790f77a34a0eb614716223b07504` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.604914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec0177-b242-4e20-b2e8-4621b42c75be None admin] RBAC: Authorizing `identity:get_project(project_id=4a71790f77a34a0eb614716223b07504)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.606349 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec0177-b242-4e20-b2e8-4621b42c75be None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.609936 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 80/177] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:08 2022] GET /identity/v3/projects/4a71790f77a34a0eb614716223b07504 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:08.615550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0177-b242-4e20-b2e8-4621b42c75be None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.654152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a09277-4267-492a-be38-066a406e3f43 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.695626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c3c6f-30f1-432d-abd7-42f952887b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.696509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c3c6f-30f1-432d-abd7-42f952887b56 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.696891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c3c6f-30f1-432d-abd7-42f952887b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.697166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c3c6f-30f1-432d-abd7-42f952887b56 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.698528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c3c6f-30f1-432d-abd7-42f952887b56 None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.700119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c3c6f-30f1-432d-abd7-42f952887b56 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.702334 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 98/178] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:08 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:08.710844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:08.716008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c3c6f-30f1-432d-abd7-42f952887b56 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:08.726010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0177-b242-4e20-b2e8-4621b42c75be None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.793334 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bec0ae-07ac-46f7-8e9d-42e4f9d5ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.794000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bec0ae-07ac-46f7-8e9d-42e4f9d5ea52 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.794287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bec0ae-07ac-46f7-8e9d-42e4f9d5ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.794561 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bec0ae-07ac-46f7-8e9d-42e4f9d5ea52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.795406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bec0ae-07ac-46f7-8e9d-42e4f9d5ea52 None admin] RBAC: Adding query filter params (role.id=88c41930377947b7a1dc0134ba0f787b, scope.project.id=4a71790f77a34a0eb614716223b07504, user.id=cf9d84554d9c4cf2a39183e67800c82b) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:08.795759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bec0ae-07ac-46f7-8e9d-42e4f9d5ea52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.797205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bec0ae-07ac-46f7-8e9d-42e4f9d5ea52 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.807861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 81/179] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:08 2022] GET /identity/v3/role_assignments?user.id=cf9d84554d9c4cf2a39183e67800c82b&scope.project.id=4a71790f77a34a0eb614716223b07504&role.id=88c41930377947b7a1dc0134ba0f787b => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:08.893834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c3c6f-30f1-432d-abd7-42f952887b56 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:08.907197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:08.942989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f302e6-4d36-46bb-8819-219722ffbeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:08.943670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f302e6-4d36-46bb-8819-219722ffbeca None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:08.943954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f302e6-4d36-46bb-8819-219722ffbeca None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:08.944230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f302e6-4d36-46bb-8819-219722ffbeca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:08.945083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f302e6-4d36-46bb-8819-219722ffbeca None admin] RBAC: Adding query filter params (role.id=47a961686ccc4c6a8bb05e0f3fe5ffba, scope.project.id=903a0b97a2f547ba915abf85091b8d33, user.id=cf9d84554d9c4cf2a39183e67800c82b) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:08.945399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f302e6-4d36-46bb-8819-219722ffbeca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:08.946888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f302e6-4d36-46bb-8819-219722ffbeca None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:08.956331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 99/180] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:08 2022] GET /identity/v3/role_assignments?user.id=cf9d84554d9c4cf2a39183e67800c82b&scope.project.id=903a0b97a2f547ba915abf85091b8d33&role.id=47a961686ccc4c6a8bb05e0f3fe5ffba => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:09.110745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559549aa-591c-4ed4-bfed-02a7026a487d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.111026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559549aa-591c-4ed4-bfed-02a7026a487d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.111580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559549aa-591c-4ed4-bfed-02a7026a487d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.113428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 82/181] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:09.118590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f005a-a45b-418a-8d68-efaff5f2f4ad None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.119108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f005a-a45b-418a-8d68-efaff5f2f4ad None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.119600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f005a-a45b-418a-8d68-efaff5f2f4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.140635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-3c5f005a-a45b-418a-8d68-efaff5f2f4ad None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:09.142465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-3c5f005a-a45b-418a-8d68-efaff5f2f4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:09.229217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 100/182] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:09.260304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559549aa-591c-4ed4-bfed-02a7026a487d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:09.369193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559549aa-591c-4ed4-bfed-02a7026a487d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:09.404437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c8927-264b-49a7-9a6d-e6ee9173f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:09.405679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c8927-264b-49a7-9a6d-e6ee9173f066 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.406153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c8927-264b-49a7-9a6d-e6ee9173f066 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.406664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c8927-264b-49a7-9a6d-e6ee9173f066 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.418040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c8927-264b-49a7-9a6d-e6ee9173f066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-1e4c8927-264b-49a7-9a6d-e6ee9173f066 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:09.426285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:09.427187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:09.428001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:09.428001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:09.428001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:09.428001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:09.428001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:09.428001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:09.428001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:09.428001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:09.428001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:09.428001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:09.428001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:09.428001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:09.430404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 83/183] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:00:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:09.436426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f005a-a45b-418a-8d68-efaff5f2f4ad None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:09.553819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:09.558986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f005a-a45b-418a-8d68-efaff5f2f4ad None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:09.600803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d3093-d972-40b4-824c-d2c56b4915d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:09.601569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3093-d972-40b4-824c-d2c56b4915d9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.601850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3093-d972-40b4-824c-d2c56b4915d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.602164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3093-d972-40b4-824c-d2c56b4915d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.602942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d3093-d972-40b4-824c-d2c56b4915d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:09.603262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d3093-d972-40b4-824c-d2c56b4915d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:09.604721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d3093-d972-40b4-824c-d2c56b4915d9 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:09.616528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 101/184] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:09.622150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c8927-264b-49a7-9a6d-e6ee9173f066 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:09.647964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:09.702151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52fcba-de15-4191-96b1-0b4f4ddfc07d None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.702462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52fcba-de15-4191-96b1-0b4f4ddfc07d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.702711 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52fcba-de15-4191-96b1-0b4f4ddfc07d None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.704145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 102/185] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:09.709510 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a8f14-d630-4026-8b50-3b0c85bf063d None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.710045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a8f14-d630-4026-8b50-3b0c85bf063d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.710547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a8f14-d630-4026-8b50-3b0c85bf063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.728839 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-d49a8f14-d630-4026-8b50-3b0c85bf063d None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:09.730095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c8927-264b-49a7-9a6d-e6ee9173f066 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:09.730887 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-d49a8f14-d630-4026-8b50-3b0c85bf063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:09.766725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ce553-fbda-4db2-8d34-d264529f72ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:09.766725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ce553-fbda-4db2-8d34-d264529f72ce None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.766725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ce553-fbda-4db2-8d34-d264529f72ce None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.766725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ce553-fbda-4db2-8d34-d264529f72ce None admin] PATH_INFO: `/v3/users/e43ff791c65f46678f18240ddb15df04` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.786061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ce553-fbda-4db2-8d34-d264529f72ce None admin] RBAC: Authorizing `identity:get_user(user_id=e43ff791c65f46678f18240ddb15df04)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:09.787988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ce553-fbda-4db2-8d34-d264529f72ce None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:09.790712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 84/186] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:09 2022] GET /identity/v3/users/e43ff791c65f46678f18240ddb15df04 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:09.796678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e76bd-070b-4c6a-8385-392d6b6aff21 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.796965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e76bd-070b-4c6a-8385-392d6b6aff21 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.797246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e76bd-070b-4c6a-8385-392d6b6aff21 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.798789 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 85/187] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:00:09.799598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e76bd-070b-4c6a-8385-392d6b6aff21 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:09.813244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 103/188] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:09.814439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d029a-b445-456f-8557-35cd75691a26 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.814726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d029a-b445-456f-8557-35cd75691a26 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.814996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d029a-b445-456f-8557-35cd75691a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:09.839002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-d94d029a-b445-456f-8557-35cd75691a26 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:09.840569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-d94d029a-b445-456f-8557-35cd75691a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:09.886079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:09.910757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 104/189] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:09.912808 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d029a-b445-456f-8557-35cd75691a26 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:09.920745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e76bd-070b-4c6a-8385-392d6b6aff21 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:09.941407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:09.958356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47225c-366a-4733-b761-9c063f6ee416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:09.959137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47225c-366a-4733-b761-9c063f6ee416 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:09.959424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47225c-366a-4733-b761-9c063f6ee416 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:09.959731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47225c-366a-4733-b761-9c063f6ee416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.019884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d029a-b445-456f-8557-35cd75691a26 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:10.032117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47225c-366a-4733-b761-9c063f6ee416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:10.034141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47225c-366a-4733-b761-9c063f6ee416 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:10.054413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91b1c3-80b5-48db-8b68-ff965bee7191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:10.055239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91b1c3-80b5-48db-8b68-ff965bee7191 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:10.055519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91b1c3-80b5-48db-8b68-ff965bee7191 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:10.055822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91b1c3-80b5-48db-8b68-ff965bee7191 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.065935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91b1c3-80b5-48db-8b68-ff965bee7191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-dc91b1c3-80b5-48db-8b68-ff965bee7191 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:10.073934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:10.074876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:10.075733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 105/190] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:00:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:10.076409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91b1c3-80b5-48db-8b68-ff965bee7191 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:10.103865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:10.135409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 86/191] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:10.136921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1ac98-2e63-4f4d-8041-8a8e07e4b2ea None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:10.137163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1ac98-2e63-4f4d-8041-8a8e07e4b2ea None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:10.137445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1ac98-2e63-4f4d-8041-8a8e07e4b2ea None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.138736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 87/192] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:10.139495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1ac98-2e63-4f4d-8041-8a8e07e4b2ea None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:10.160919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:10.179118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91b1c3-80b5-48db-8b68-ff965bee7191 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:10.212776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62c6f-984a-4dfb-a887-7188e8e54be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:10.213593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62c6f-984a-4dfb-a887-7188e8e54be5 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:10.213874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62c6f-984a-4dfb-a887-7188e8e54be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:10.214148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62c6f-984a-4dfb-a887-7188e8e54be5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.225484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af62c6f-984a-4dfb-a887-7188e8e54be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-4af62c6f-984a-4dfb-a887-7188e8e54be5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:10.237448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:10.238393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:10.239179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:10.239179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:10.239179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:10.239179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:10.239179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:10.239179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:10.239179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:10.239179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:10.239179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:10.239179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:10.239179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:10.239179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:10.240131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 106/193] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:10.240198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1ac98-2e63-4f4d-8041-8a8e07e4b2ea None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:10.240590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62c6f-984a-4dfb-a887-7188e8e54be5 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:10.277297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceec56-2486-44ee-b116-92b5cdbce305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:10.277998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceec56-2486-44ee-b116-92b5cdbce305 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:10.278275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceec56-2486-44ee-b116-92b5cdbce305 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:10.278549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceec56-2486-44ee-b116-92b5cdbce305 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.279301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceec56-2486-44ee-b116-92b5cdbce305 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:10.279617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceec56-2486-44ee-b116-92b5cdbce305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:10.281005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceec56-2486-44ee-b116-92b5cdbce305 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:10.288792 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 88/194] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:10.290155 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358beb4a-c20f-4162-b854-ced509c15efb None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:10.290443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358beb4a-c20f-4162-b854-ced509c15efb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:10.290720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358beb4a-c20f-4162-b854-ced509c15efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.308066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-358beb4a-c20f-4162-b854-ced509c15efb None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:10.309315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-358beb4a-c20f-4162-b854-ced509c15efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:10.337022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:10.345911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62c6f-984a-4dfb-a887-7188e8e54be5 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:10.379490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582add1-1490-4d9c-bb40-9a2b25b0d5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:10.379900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 89/195] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:10.380368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582add1-1490-4d9c-bb40-9a2b25b0d5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:10.380649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582add1-1490-4d9c-bb40-9a2b25b0d5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:10.380761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358beb4a-c20f-4162-b854-ced509c15efb None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:10.380917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582add1-1490-4d9c-bb40-9a2b25b0d5e7 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.382112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582add1-1490-4d9c-bb40-9a2b25b0d5e7 None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:10.383588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582add1-1490-4d9c-bb40-9a2b25b0d5e7 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:10.385282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 107/196] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:10 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:10.386003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582add1-1490-4d9c-bb40-9a2b25b0d5e7 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:10.398450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:10.489383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582add1-1490-4d9c-bb40-9a2b25b0d5e7 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:10.492228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358beb4a-c20f-4162-b854-ced509c15efb None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:10.525984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74a4ba-48e6-40b9-b3e2-fa109e4260ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:10.526719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73c8f0-7f71-402e-8722-b1e15f8a667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:10.526886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74a4ba-48e6-40b9-b3e2-fa109e4260ca None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:10.527174 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74a4ba-48e6-40b9-b3e2-fa109e4260ca None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:10.527390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73c8f0-7f71-402e-8722-b1e15f8a667b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:10.527491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74a4ba-48e6-40b9-b3e2-fa109e4260ca None admin] PATH_INFO: `/v3/users/e43ff791c65f46678f18240ddb15df04` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.527700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73c8f0-7f71-402e-8722-b1e15f8a667b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:10.527990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73c8f0-7f71-402e-8722-b1e15f8a667b None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.528770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74a4ba-48e6-40b9-b3e2-fa109e4260ca None admin] RBAC: Authorizing `identity:get_user(user_id=e43ff791c65f46678f18240ddb15df04)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:10.528902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73c8f0-7f71-402e-8722-b1e15f8a667b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:10.529114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73c8f0-7f71-402e-8722-b1e15f8a667b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:10.530234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74a4ba-48e6-40b9-b3e2-fa109e4260ca None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:10.530548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73c8f0-7f71-402e-8722-b1e15f8a667b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:10.531934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 108/197] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:10 2022] GET /identity/v3/users/e43ff791c65f46678f18240ddb15df04 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:10.536500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74a4ba-48e6-40b9-b3e2-fa109e4260ca None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:10.540589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 90/198] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:10.541610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73c8f0-7f71-402e-8722-b1e15f8a667b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:10.571267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:10.621304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:10.644603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74a4ba-48e6-40b9-b3e2-fa109e4260ca None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:10.659414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73c8f0-7f71-402e-8722-b1e15f8a667b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:10.678191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e176e1-7547-49cb-ab9c-1f804c06c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:10.678848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e176e1-7547-49cb-ab9c-1f804c06c853 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:10.679133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e176e1-7547-49cb-ab9c-1f804c06c853 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:10.679409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e176e1-7547-49cb-ab9c-1f804c06c853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.680273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e176e1-7547-49cb-ab9c-1f804c06c853 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=17512cd0708a4c7aa66913e0ed2c1768, user.id=e43ff791c65f46678f18240ddb15df04) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:10.680601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e176e1-7547-49cb-ab9c-1f804c06c853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:10.682047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e176e1-7547-49cb-ab9c-1f804c06c853 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:10.687440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 109/199] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:10 2022] GET /identity/v3/role_assignments?user.id=e43ff791c65f46678f18240ddb15df04&scope.project.id=17512cd0708a4c7aa66913e0ed2c1768&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:10.688276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e176e1-7547-49cb-ab9c-1f804c06c853 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:10.706107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12b45e-bee4-40c9-a9cf-23af9148a9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:10.707235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12b45e-bee4-40c9-a9cf-23af9148a9fb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:10.707523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12b45e-bee4-40c9-a9cf-23af9148a9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:10.708114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12b45e-bee4-40c9-a9cf-23af9148a9fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.709525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12b45e-bee4-40c9-a9cf-23af9148a9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:10.711015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12b45e-bee4-40c9-a9cf-23af9148a9fb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:10.712798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 91/200] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:10.714223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12b45e-bee4-40c9-a9cf-23af9148a9fb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:10.809617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e176e1-7547-49cb-ab9c-1f804c06c853 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:10.820806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:10.827987 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12b45e-bee4-40c9-a9cf-23af9148a9fb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:10.855097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e43c9b-cee8-4eab-aef2-1bcdf6f4872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:10.855802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e43c9b-cee8-4eab-aef2-1bcdf6f4872e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:10.856088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e43c9b-cee8-4eab-aef2-1bcdf6f4872e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:10.856361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e43c9b-cee8-4eab-aef2-1bcdf6f4872e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.871095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:10.876626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470ace8-e259-49ec-a77e-d3f7978413f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:10.877541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470ace8-e259-49ec-a77e-d3f7978413f9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:10.877975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470ace8-e259-49ec-a77e-d3f7978413f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:10.878251 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470ace8-e259-49ec-a77e-d3f7978413f9 None admin] PATH_INFO: `/v3/users/e404761da2934fe3a03e6c59ab6d6621` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:10.879822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470ace8-e259-49ec-a77e-d3f7978413f9 None admin] RBAC: Authorizing `identity:get_user(user_id=e404761da2934fe3a03e6c59ab6d6621)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:10.881276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470ace8-e259-49ec-a77e-d3f7978413f9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:10.882934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 92/201] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:10 2022] GET /identity/v3/users/e404761da2934fe3a03e6c59ab6d6621 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:10.883709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470ace8-e259-49ec-a77e-d3f7978413f9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:10.934073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e43c9b-cee8-4eab-aef2-1bcdf6f4872e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:10.935493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e43c9b-cee8-4eab-aef2-1bcdf6f4872e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:10.991065 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470ace8-e259-49ec-a77e-d3f7978413f9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:11.030997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a877ec-0665-4186-a605-6d17e929feb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:11.031715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a877ec-0665-4186-a605-6d17e929feb9 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:11.032005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a877ec-0665-4186-a605-6d17e929feb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:11.032501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a877ec-0665-4186-a605-6d17e929feb9 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:11.033011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a877ec-0665-4186-a605-6d17e929feb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:11.034459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a877ec-0665-4186-a605-6d17e929feb9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:11.043354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 110/202] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:11.043354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e43c9b-cee8-4eab-aef2-1bcdf6f4872e None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:11.059970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 93/203] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:00:10 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:11.060823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a877ec-0665-4186-a605-6d17e929feb9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:11.087517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:11.092884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:11.160068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e43c9b-cee8-4eab-aef2-1bcdf6f4872e None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:11.205662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3769e7-abcc-4be5-85c0-5f03577a58cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:11.206294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3769e7-abcc-4be5-85c0-5f03577a58cd None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:11.206831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3769e7-abcc-4be5-85c0-5f03577a58cd None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:11.207108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3769e7-abcc-4be5-85c0-5f03577a58cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:11.208226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a877ec-0665-4186-a605-6d17e929feb9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:11.248544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd507a-715b-4758-9c88-2628ec2bf8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:11.249476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd507a-715b-4758-9c88-2628ec2bf8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:11.249758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd507a-715b-4758-9c88-2628ec2bf8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:11.250035 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd507a-715b-4758-9c88-2628ec2bf8d4 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:11.251407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd507a-715b-4758-9c88-2628ec2bf8d4 None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:11.252946 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd507a-715b-4758-9c88-2628ec2bf8d4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:11.254738 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 94/204] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:11 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:11.260665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd507a-715b-4758-9c88-2628ec2bf8d4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:11.295684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3769e7-abcc-4be5-85c0-5f03577a58cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:11.297196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3769e7-abcc-4be5-85c0-5f03577a58cd None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:11.343820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:11.377811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:11.401260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd507a-715b-4758-9c88-2628ec2bf8d4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:11.421905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 111/205] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:11.427643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3769e7-abcc-4be5-85c0-5f03577a58cd None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:11.445170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcd29c-5cab-4444-a7ec-7d240e218c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:11.445850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcd29c-5cab-4444-a7ec-7d240e218c45 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:11.446134 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcd29c-5cab-4444-a7ec-7d240e218c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:11.446410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcd29c-5cab-4444-a7ec-7d240e218c45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:11.447272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcd29c-5cab-4444-a7ec-7d240e218c45 None admin] RBAC: Adding query filter params (role.id=47a961686ccc4c6a8bb05e0f3fe5ffba, scope.project.id=17512cd0708a4c7aa66913e0ed2c1768, user.id=e43ff791c65f46678f18240ddb15df04) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:11.448466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcd29c-5cab-4444-a7ec-7d240e218c45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:11.449986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcd29c-5cab-4444-a7ec-7d240e218c45 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:11.457708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 95/206] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:11 2022] GET /identity/v3/role_assignments?user.id=e43ff791c65f46678f18240ddb15df04&scope.project.id=17512cd0708a4c7aa66913e0ed2c1768&role.id=47a961686ccc4c6a8bb05e0f3fe5ffba => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:11.547182 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3769e7-abcc-4be5-85c0-5f03577a58cd None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:11.590222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76186004-f787-4982-bb73-63c0f453b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:11.591135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186004-f787-4982-bb73-63c0f453b298 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:11.591416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186004-f787-4982-bb73-63c0f453b298 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:11.591792 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186004-f787-4982-bb73-63c0f453b298 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:11.594506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76186004-f787-4982-bb73-63c0f453b298 None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:11.596097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76186004-f787-4982-bb73-63c0f453b298 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:11.598126 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 112/207] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:11 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:11.604081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcd29c-5cab-4444-a7ec-7d240e218c45 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:11.728949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcd29c-5cab-4444-a7ec-7d240e218c45 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:11.763061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070fa2c-1e88-4ed2-a414-36babe10a904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:11.763879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070fa2c-1e88-4ed2-a414-36babe10a904 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:11.764165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070fa2c-1e88-4ed2-a414-36babe10a904 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:11.764440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070fa2c-1e88-4ed2-a414-36babe10a904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:11.765284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070fa2c-1e88-4ed2-a414-36babe10a904 None admin] RBAC: Adding query filter params (role.id=5cd390b79218462b9837d41be8ec8b5c, scope.project.id=903a0b97a2f547ba915abf85091b8d33, user.id=e404761da2934fe3a03e6c59ab6d6621) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:11.765594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070fa2c-1e88-4ed2-a414-36babe10a904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:11.767052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070fa2c-1e88-4ed2-a414-36babe10a904 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:11.773412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 96/208] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:11 2022] GET /identity/v3/role_assignments?user.id=e404761da2934fe3a03e6c59ab6d6621&scope.project.id=903a0b97a2f547ba915abf85091b8d33&role.id=5cd390b79218462b9837d41be8ec8b5c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:13.081316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15429ba-a603-412a-9dea-01794f4e0cc5 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.082334 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15429ba-a603-412a-9dea-01794f4e0cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.082829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15429ba-a603-412a-9dea-01794f4e0cc5 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.084688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 113/209] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:13.090092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d2ef6-23ff-4fec-960e-16956f91ef7d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.090503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d2ef6-23ff-4fec-960e-16956f91ef7d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.090662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d2ef6-23ff-4fec-960e-16956f91ef7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.108017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d01d2ef6-23ff-4fec-960e-16956f91ef7d None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:13.109224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d01d2ef6-23ff-4fec-960e-16956f91ef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:13.119416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:13.178993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 97/210] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:13.200788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15429ba-a603-412a-9dea-01794f4e0cc5 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:13.213932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:13.305719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15429ba-a603-412a-9dea-01794f4e0cc5 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:13.340236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d05d23-464a-4bdc-ab62-9011682d279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:13.341366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d05d23-464a-4bdc-ab62-9011682d279c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.341853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d05d23-464a-4bdc-ab62-9011682d279c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.342315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d05d23-464a-4bdc-ab62-9011682d279c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.353104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d05d23-464a-4bdc-ab62-9011682d279c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-90d05d23-464a-4bdc-ab62-9011682d279c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:13.361207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:13.362141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:13.362933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:13.362933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:13.362933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:13.362933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:13.362933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:13.362933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:13.362933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:13.362933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:13.362933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:13.362933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:13.362933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:13.362933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:13.366285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 114/211] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:00:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:13.372506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d2ef6-23ff-4fec-960e-16956f91ef7d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:13.476021 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d2ef6-23ff-4fec-960e-16956f91ef7d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:13.510577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3d0b9-9a9c-4b49-aca9-a8b7ccad7300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:13.511260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3d0b9-9a9c-4b49-aca9-a8b7ccad7300 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.511542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3d0b9-9a9c-4b49-aca9-a8b7ccad7300 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.511850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3d0b9-9a9c-4b49-aca9-a8b7ccad7300 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.512613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3d0b9-9a9c-4b49-aca9-a8b7ccad7300 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:13.512916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3d0b9-9a9c-4b49-aca9-a8b7ccad7300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:13.514291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3d0b9-9a9c-4b49-aca9-a8b7ccad7300 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:13.524308 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 98/212] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:13.530139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d05d23-464a-4bdc-ab62-9011682d279c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:13.580727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1483c2-ad15-46a2-b78d-0d8264706fee None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.581039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1483c2-ad15-46a2-b78d-0d8264706fee None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.581281 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1483c2-ad15-46a2-b78d-0d8264706fee None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.582901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 99/213] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:13.587951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ad9de-7ccb-41cb-b3fe-f290d79cb2a0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.588234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ad9de-7ccb-41cb-b3fe-f290d79cb2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.588513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ad9de-7ccb-41cb-b3fe-f290d79cb2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.603989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:13.605289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:13.607281 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-504ad9de-7ccb-41cb-b3fe-f290d79cb2a0 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:13.608507 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-504ad9de-7ccb-41cb-b3fe-f290d79cb2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:13.637937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d05d23-464a-4bdc-ab62-9011682d279c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:13.672644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c1f57-75d8-4893-99c5-d389b79e4dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:13.673951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c1f57-75d8-4893-99c5-d389b79e4dac None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.674432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c1f57-75d8-4893-99c5-d389b79e4dac None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.674900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c1f57-75d8-4893-99c5-d389b79e4dac None admin] PATH_INFO: `/v3/users/e43ff791c65f46678f18240ddb15df04` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.676531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c1f57-75d8-4893-99c5-d389b79e4dac None admin] RBAC: Authorizing `identity:get_user(user_id=e43ff791c65f46678f18240ddb15df04)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:13.678326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c1f57-75d8-4893-99c5-d389b79e4dac None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:13.680746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 115/214] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:13 2022] GET /identity/v3/users/e43ff791c65f46678f18240ddb15df04 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:13.686450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c1f57-75d8-4893-99c5-d389b79e4dac None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:13.689813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 100/215] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:13.707911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ad9de-7ccb-41cb-b3fe-f290d79cb2a0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:13.790203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c1f57-75d8-4893-99c5-d389b79e4dac None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:13.810709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ad9de-7ccb-41cb-b3fe-f290d79cb2a0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:13.826506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bae36a-ad60-41a8-a78e-ad6700c31946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:13.827959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae36a-ad60-41a8-a78e-ad6700c31946 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.828726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae36a-ad60-41a8-a78e-ad6700c31946 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.829196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae36a-ad60-41a8-a78e-ad6700c31946 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.830955 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bae36a-ad60-41a8-a78e-ad6700c31946 None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:13.833168 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bae36a-ad60-41a8-a78e-ad6700c31946 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:13.836016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 116/216] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:13 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:13.840717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0485dde-80bd-4382-8f24-0e1061b10ffa None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.840717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0485dde-80bd-4382-8f24-0e1061b10ffa None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.840717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0485dde-80bd-4382-8f24-0e1061b10ffa None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.840717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 117/217] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:13.844911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0485dde-80bd-4382-8f24-0e1061b10ffa None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:13.851382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52a539-6c6a-495c-bf87-fe588da49a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:13.852224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a539-6c6a-495c-bf87-fe588da49a4c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.852504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a539-6c6a-495c-bf87-fe588da49a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.852775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a539-6c6a-495c-bf87-fe588da49a4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.854791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:13.855647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:13.865651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52a539-6c6a-495c-bf87-fe588da49a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7e52a539-6c6a-495c-bf87-fe588da49a4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:13.873528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:13.874422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 101/218] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:13.879927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564f603-4704-4a45-b6db-e26d5e24d21e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.880626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564f603-4704-4a45-b6db-e26d5e24d21e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.880626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564f603-4704-4a45-b6db-e26d5e24d21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.893013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4564f603-4704-4a45-b6db-e26d5e24d21e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:13.894189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4564f603-4704-4a45-b6db-e26d5e24d21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:13.948622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0485dde-80bd-4382-8f24-0e1061b10ffa None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:13.960374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 102/219] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:13.961704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476a9c5-0fdd-4918-a7f3-ed3ab3cb36a8 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.961992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476a9c5-0fdd-4918-a7f3-ed3ab3cb36a8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.962270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476a9c5-0fdd-4918-a7f3-ed3ab3cb36a8 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.963713 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 103/220] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:13.964245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476a9c5-0fdd-4918-a7f3-ed3ab3cb36a8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:13.990491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab143040-b182-4358-8041-7c1bd42062b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:13.991399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab143040-b182-4358-8041-7c1bd42062b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:13.991718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab143040-b182-4358-8041-7c1bd42062b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:13.992009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab143040-b182-4358-8041-7c1bd42062b8 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768/users/e43ff791c65f46678f18240ddb15df04/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:13.993999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab143040-b182-4358-8041-7c1bd42062b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=17512cd0708a4c7aa66913e0ed2c1768, user_id=e43ff791c65f46678f18240ddb15df04, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:13.995471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab143040-b182-4358-8041-7c1bd42062b8 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:14.008186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 118/221] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:00:13 2022] PUT /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768/users/e43ff791c65f46678f18240ddb15df04/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:14.009470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f37ce-a796-4ec8-810d-166ed2d22c8f None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:14.009767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f37ce-a796-4ec8-810d-166ed2d22c8f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:14.010048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f37ce-a796-4ec8-810d-166ed2d22c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:14.029579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-bb1f37ce-a796-4ec8-810d-166ed2d22c8f None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:14.031255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-bb1f37ce-a796-4ec8-810d-166ed2d22c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:14.086951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476a9c5-0fdd-4918-a7f3-ed3ab3cb36a8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:14.102046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:14.112846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 119/222] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:14.114678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f37ce-a796-4ec8-810d-166ed2d22c8f None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:14.120579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:14.131733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620fc44-4dab-4657-97da-0cde05fd0e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:14.132768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620fc44-4dab-4657-97da-0cde05fd0e3f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:14.133343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620fc44-4dab-4657-97da-0cde05fd0e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:14.133767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620fc44-4dab-4657-97da-0cde05fd0e3f None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:14.134613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620fc44-4dab-4657-97da-0cde05fd0e3f None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:14.134936 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620fc44-4dab-4657-97da-0cde05fd0e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:14.136537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620fc44-4dab-4657-97da-0cde05fd0e3f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:14.146306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 104/223] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:14.147180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620fc44-4dab-4657-97da-0cde05fd0e3f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:14.242619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f37ce-a796-4ec8-810d-166ed2d22c8f None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:14.257191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620fc44-4dab-4657-97da-0cde05fd0e3f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:14.278959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b957e-eaf7-4fe3-81c7-d97784feb907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:14.279801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b957e-eaf7-4fe3-81c7-d97784feb907 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:14.280096 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b957e-eaf7-4fe3-81c7-d97784feb907 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:14.280374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b957e-eaf7-4fe3-81c7-d97784feb907 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:14.281548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b957e-eaf7-4fe3-81c7-d97784feb907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:14.283069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b957e-eaf7-4fe3-81c7-d97784feb907 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:14.289212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 120/224] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:14.289212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b957e-eaf7-4fe3-81c7-d97784feb907 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:14.295031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36e8b3-0eeb-4b4b-a431-45b8ff8021d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:14.295885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36e8b3-0eeb-4b4b-a431-45b8ff8021d7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:14.296169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36e8b3-0eeb-4b4b-a431-45b8ff8021d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:14.296444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36e8b3-0eeb-4b4b-a431-45b8ff8021d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:14.306636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36e8b3-0eeb-4b4b-a431-45b8ff8021d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4c36e8b3-0eeb-4b4b-a431-45b8ff8021d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:14.314793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:14.315709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:14.316562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 105/225] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:00:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:14.317229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36e8b3-0eeb-4b4b-a431-45b8ff8021d7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:14.360502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:14.370009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:14.403081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b957e-eaf7-4fe3-81c7-d97784feb907 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:14.422422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36e8b3-0eeb-4b4b-a431-45b8ff8021d7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:14.440176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6e3ec-c015-4153-9ff5-adf14f57434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:14.441139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6e3ec-c015-4153-9ff5-adf14f57434a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:14.441491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6e3ec-c015-4153-9ff5-adf14f57434a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:14.441835 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6e3ec-c015-4153-9ff5-adf14f57434a None admin] PATH_INFO: `/v3/users/db1271d4ab7c4e889eb7fa897ebeb3f8` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:14.457989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6e3ec-c015-4153-9ff5-adf14f57434a None admin] RBAC: Authorizing `identity:get_user(user_id=db1271d4ab7c4e889eb7fa897ebeb3f8)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:14.459467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6e3ec-c015-4153-9ff5-adf14f57434a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:14.461521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 121/226] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:14 2022] GET /identity/v3/users/db1271d4ab7c4e889eb7fa897ebeb3f8 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:14.462391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6e3ec-c015-4153-9ff5-adf14f57434a None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:14.469580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364e1b9-21f8-4c53-b2a7-e66a7aa2c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:14.470417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e1b9-21f8-4c53-b2a7-e66a7aa2c669 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:14.471113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e1b9-21f8-4c53-b2a7-e66a7aa2c669 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:14.471397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e1b9-21f8-4c53-b2a7-e66a7aa2c669 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:14.472169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364e1b9-21f8-4c53-b2a7-e66a7aa2c669 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:14.473988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364e1b9-21f8-4c53-b2a7-e66a7aa2c669 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:14.503594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 106/227] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:00:14 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:14.503594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364e1b9-21f8-4c53-b2a7-e66a7aa2c669 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:14.594104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6e3ec-c015-4153-9ff5-adf14f57434a None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:14.621262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:14.634206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f506-e5bb-4bef-a382-987555903a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:14.635228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f506-e5bb-4bef-a382-987555903a58 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:14.635628 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f506-e5bb-4bef-a382-987555903a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:14.636096 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f506-e5bb-4bef-a382-987555903a58 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:14.636986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f506-e5bb-4bef-a382-987555903a58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:14.637463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f506-e5bb-4bef-a382-987555903a58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:14.639162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f506-e5bb-4bef-a382-987555903a58 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:14.642626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364e1b9-21f8-4c53-b2a7-e66a7aa2c669 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:14.645318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:14.654327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 122/228] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:14.661296 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f506-e5bb-4bef-a382-987555903a58 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:14.690475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a00250-42e1-4888-a5cc-399758e051de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:14.692478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a00250-42e1-4888-a5cc-399758e051de None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:14.692478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a00250-42e1-4888-a5cc-399758e051de None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:14.692478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a00250-42e1-4888-a5cc-399758e051de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:14.780347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a00250-42e1-4888-a5cc-399758e051de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:14.781829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a00250-42e1-4888-a5cc-399758e051de None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:14.791321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f506-e5bb-4bef-a382-987555903a58 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:14.836631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a61b-9079-48e3-ab74-2079b1b106cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:14.837830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a61b-9079-48e3-ab74-2079b1b106cf None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:14.838121 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a61b-9079-48e3-ab74-2079b1b106cf None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:14.838402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a61b-9079-48e3-ab74-2079b1b106cf None admin] PATH_INFO: `/v3/users/e43ff791c65f46678f18240ddb15df04` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:14.839682 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a61b-9079-48e3-ab74-2079b1b106cf None admin] RBAC: Authorizing `identity:get_user(user_id=e43ff791c65f46678f18240ddb15df04)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:14.841630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a61b-9079-48e3-ab74-2079b1b106cf None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:14.846419 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 123/229] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:14 2022] GET /identity/v3/users/e43ff791c65f46678f18240ddb15df04 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:14.851170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a61b-9079-48e3-ab74-2079b1b106cf None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:14.911062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 107/230] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:14.915811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:14.918740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a00250-42e1-4888-a5cc-399758e051de None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:14.922694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:14.971391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a61b-9079-48e3-ab74-2079b1b106cf None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:15.008002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d07636-712f-421e-a8f5-47b9d70a0d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:15.008885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d07636-712f-421e-a8f5-47b9d70a0d04 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:15.009166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d07636-712f-421e-a8f5-47b9d70a0d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:15.009442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d07636-712f-421e-a8f5-47b9d70a0d04 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:15.010756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d07636-712f-421e-a8f5-47b9d70a0d04 None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:15.012403 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d07636-712f-421e-a8f5-47b9d70a0d04 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:15.014427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 124/231] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:14 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:15.019984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d07636-712f-421e-a8f5-47b9d70a0d04 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:15.039284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a00250-42e1-4888-a5cc-399758e051de None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:15.081360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5d59d-48a9-4aa1-91cc-b052c36b50ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:15.082811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5d59d-48a9-4aa1-91cc-b052c36b50ca None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:15.083225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5d59d-48a9-4aa1-91cc-b052c36b50ca None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:15.083515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5d59d-48a9-4aa1-91cc-b052c36b50ca None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:15.085313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5d59d-48a9-4aa1-91cc-b052c36b50ca None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:15.086949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5d59d-48a9-4aa1-91cc-b052c36b50ca None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:15.089438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 108/232] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:14 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:15.096352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5d59d-48a9-4aa1-91cc-b052c36b50ca None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:15.134683 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d07636-712f-421e-a8f5-47b9d70a0d04 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:15.156460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:15.171811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd067d-e554-417d-bac5-d868f65c55b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:15.172643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd067d-e554-417d-bac5-d868f65c55b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:15.172979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd067d-e554-417d-bac5-d868f65c55b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:15.173473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd067d-e554-417d-bac5-d868f65c55b2 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768/users/e43ff791c65f46678f18240ddb15df04/roles/47a961686ccc4c6a8bb05e0f3fe5ffba` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:15.175844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd067d-e554-417d-bac5-d868f65c55b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=17512cd0708a4c7aa66913e0ed2c1768, user_id=e43ff791c65f46678f18240ddb15df04, role_id=47a961686ccc4c6a8bb05e0f3fe5ffba)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:15.177322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd067d-e554-417d-bac5-d868f65c55b2 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:15.185728 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:15.208954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 125/233] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:00:15 2022] PUT /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768/users/e43ff791c65f46678f18240ddb15df04/roles/47a961686ccc4c6a8bb05e0f3fe5ffba => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:15.220374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5d59d-48a9-4aa1-91cc-b052c36b50ca None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:15.257678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc1c6d-eb67-4789-93b8-29310e22e326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:15.258363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc1c6d-eb67-4789-93b8-29310e22e326 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:15.258645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc1c6d-eb67-4789-93b8-29310e22e326 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:15.258924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc1c6d-eb67-4789-93b8-29310e22e326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:15.259818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc1c6d-eb67-4789-93b8-29310e22e326 None admin] RBAC: Adding query filter params (role.id=88c41930377947b7a1dc0134ba0f787b, scope.project.id=17512cd0708a4c7aa66913e0ed2c1768, user.id=db1271d4ab7c4e889eb7fa897ebeb3f8) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:15.260137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc1c6d-eb67-4789-93b8-29310e22e326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:15.261665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc1c6d-eb67-4789-93b8-29310e22e326 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:15.268355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 109/234] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:15 2022] GET /identity/v3/role_assignments?user.id=db1271d4ab7c4e889eb7fa897ebeb3f8&scope.project.id=17512cd0708a4c7aa66913e0ed2c1768&role.id=88c41930377947b7a1dc0134ba0f787b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:16.621913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e3b83-34f4-4609-b16a-a8941a9ed33b None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:16.622435 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e3b83-34f4-4609-b16a-a8941a9ed33b None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:16.622513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e3b83-34f4-4609-b16a-a8941a9ed33b None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:16.624068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 126/235] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:16.640316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1f4d6-03fe-4a26-9adb-82dbd56e34ac None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:16.640799 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1f4d6-03fe-4a26-9adb-82dbd56e34ac None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:16.640874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1f4d6-03fe-4a26-9adb-82dbd56e34ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:16.664622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d1b1f4d6-03fe-4a26-9adb-82dbd56e34ac None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:16.665830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d1b1f4d6-03fe-4a26-9adb-82dbd56e34ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:16.748663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 110/236] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:16.785169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e3b83-34f4-4609-b16a-a8941a9ed33b None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:16.932259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e3b83-34f4-4609-b16a-a8941a9ed33b None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:16.981597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59fd76-8723-47b9-ba7a-5cbe12631c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:16.982411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59fd76-8723-47b9-ba7a-5cbe12631c0f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:16.982696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59fd76-8723-47b9-ba7a-5cbe12631c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:16.982977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59fd76-8723-47b9-ba7a-5cbe12631c0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:16.997841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59fd76-8723-47b9-ba7a-5cbe12631c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-5d59fd76-8723-47b9-ba7a-5cbe12631c0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:17.005701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:17.006588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:17.007688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 127/237] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:17.014714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1f4d6-03fe-4a26-9adb-82dbd56e34ac None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:17.138455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:17.166924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1f4d6-03fe-4a26-9adb-82dbd56e34ac None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:17.204880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb58af-377b-4dc5-877e-12a8e8f02604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:17.205577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb58af-377b-4dc5-877e-12a8e8f02604 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.205861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb58af-377b-4dc5-877e-12a8e8f02604 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.206138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb58af-377b-4dc5-877e-12a8e8f02604 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.207062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb58af-377b-4dc5-877e-12a8e8f02604 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:17.207374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb58af-377b-4dc5-877e-12a8e8f02604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:17.208893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb58af-377b-4dc5-877e-12a8e8f02604 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:17.218709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 111/238] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:17.224716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59fd76-8723-47b9-ba7a-5cbe12631c0f None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:17.288307 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:17.366392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59fd76-8723-47b9-ba7a-5cbe12631c0f None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:17.379389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33dfc9-7eeb-4d47-8324-e5e555cb37bc None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.379725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33dfc9-7eeb-4d47-8324-e5e555cb37bc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.380016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33dfc9-7eeb-4d47-8324-e5e555cb37bc None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.381685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 112/239] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:17.386817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae07c0e-e6cb-41f3-bb22-e80680291fa1 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.387112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae07c0e-e6cb-41f3-bb22-e80680291fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.387397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae07c0e-e6cb-41f3-bb22-e80680291fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.405474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495090c6-96a0-444e-b701-6e7914810272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:17.406368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495090c6-96a0-444e-b701-6e7914810272 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.406651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495090c6-96a0-444e-b701-6e7914810272 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.406775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1ae07c0e-e6cb-41f3-bb22-e80680291fa1 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:17.406938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495090c6-96a0-444e-b701-6e7914810272 None admin] PATH_INFO: `/v3/users/e43ff791c65f46678f18240ddb15df04` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.407957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1ae07c0e-e6cb-41f3-bb22-e80680291fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:17.408154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495090c6-96a0-444e-b701-6e7914810272 None admin] RBAC: Authorizing `identity:get_user(user_id=e43ff791c65f46678f18240ddb15df04)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:17.409631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495090c6-96a0-444e-b701-6e7914810272 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:17.411729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 128/240] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:17 2022] GET /identity/v3/users/e43ff791c65f46678f18240ddb15df04 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:17.412937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33502-207b-425d-8f54-3ae8a005f94a None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.413221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33502-207b-425d-8f54-3ae8a005f94a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.413496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33502-207b-425d-8f54-3ae8a005f94a None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.414926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 129/241] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:17.421148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a651b-845a-4d0e-bb10-209d0d82315f None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.421440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a651b-845a-4d0e-bb10-209d0d82315f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.421722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a651b-845a-4d0e-bb10-209d0d82315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.444480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-bf1a651b-845a-4d0e-bb10-209d0d82315f None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:17.445788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-bf1a651b-845a-4d0e-bb10-209d0d82315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:17.492597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 113/242] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:17.493823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae07c0e-e6cb-41f3-bb22-e80680291fa1 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:17.535660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 130/243] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:17.536817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a651b-845a-4d0e-bb10-209d0d82315f None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:17.578214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:17.586057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:17.631570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae07c0e-e6cb-41f3-bb22-e80680291fa1 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:17.643430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a651b-845a-4d0e-bb10-209d0d82315f None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:17.669685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36705f8e-7058-4da3-97c0-e2a879f9d522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:17.671200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36705f8e-7058-4da3-97c0-e2a879f9d522 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.671548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36705f8e-7058-4da3-97c0-e2a879f9d522 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.671922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36705f8e-7058-4da3-97c0-e2a879f9d522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.688856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5ca44-60a3-41f1-9bd7-204fb79f5cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:17.689988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5ca44-60a3-41f1-9bd7-204fb79f5cca None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.690582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5ca44-60a3-41f1-9bd7-204fb79f5cca None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.691053 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5ca44-60a3-41f1-9bd7-204fb79f5cca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.693644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5ca44-60a3-41f1-9bd7-204fb79f5cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:17.695120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5ca44-60a3-41f1-9bd7-204fb79f5cca None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:17.697133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 131/244] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:17.698054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5ca44-60a3-41f1-9bd7-204fb79f5cca None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:17.763758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36705f8e-7058-4da3-97c0-e2a879f9d522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:17.765881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36705f8e-7058-4da3-97c0-e2a879f9d522 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:17.805970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5ca44-60a3-41f1-9bd7-204fb79f5cca None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:17.816382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:17.834370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:17.854813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1231c0-b6e4-4213-a0ea-55d3d8b391e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:17.856489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1231c0-b6e4-4213-a0ea-55d3d8b391e0 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.856990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1231c0-b6e4-4213-a0ea-55d3d8b391e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.857273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1231c0-b6e4-4213-a0ea-55d3d8b391e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.869203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1231c0-b6e4-4213-a0ea-55d3d8b391e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-dd1231c0-b6e4-4213-a0ea-55d3d8b391e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:17.876947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:17.877933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:17.878745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 132/245] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:17.880484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1231c0-b6e4-4213-a0ea-55d3d8b391e0 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:17.884233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 114/246] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:17.885692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe479e4e-6c12-4467-a7a3-43ebbccf2ba3 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:17.886581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe479e4e-6c12-4467-a7a3-43ebbccf2ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:17.886581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe479e4e-6c12-4467-a7a3-43ebbccf2ba3 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:17.891958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 115/247] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:17.891958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe479e4e-6c12-4467-a7a3-43ebbccf2ba3 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:17.986315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1231c0-b6e4-4213-a0ea-55d3d8b391e0 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:17.999199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe479e4e-6c12-4467-a7a3-43ebbccf2ba3 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.021637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c0b71-518d-447b-98be-187e4aa20ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.022340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c0b71-518d-447b-98be-187e4aa20ca4 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.022631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c0b71-518d-447b-98be-187e4aa20ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.022909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c0b71-518d-447b-98be-187e4aa20ca4 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.023731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c0b71-518d-447b-98be-187e4aa20ca4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.025202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c0b71-518d-447b-98be-187e4aa20ca4 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:18.034537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c8955-d104-47e5-bf03-f98936f79b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.035283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c8955-d104-47e5-bf03-f98936f79b34 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.035752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c8955-d104-47e5-bf03-f98936f79b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.036050 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c8955-d104-47e5-bf03-f98936f79b34 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.036843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c8955-d104-47e5-bf03-f98936f79b34 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:18.037146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c8955-d104-47e5-bf03-f98936f79b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.038627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c8955-d104-47e5-bf03-f98936f79b34 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:18.044865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 133/248] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:00:17 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:18.045869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c0b71-518d-447b-98be-187e4aa20ca4 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.060461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 116/249] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:18.060461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba12eb7-2b8b-4158-b225-9521e1795163 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.060461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba12eb7-2b8b-4158-b225-9521e1795163 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.060461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba12eb7-2b8b-4158-b225-9521e1795163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.079384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:18.083449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2ba12eb7-2b8b-4158-b225-9521e1795163 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:18.085207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2ba12eb7-2b8b-4158-b225-9521e1795163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:18.106063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:18.177829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c0b71-518d-447b-98be-187e4aa20ca4 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.193005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 117/250] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:18.194584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba12eb7-2b8b-4158-b225-9521e1795163 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.222050 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57617fe2-2012-4146-8990-42845df67a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.222990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57617fe2-2012-4146-8990-42845df67a93 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.223357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57617fe2-2012-4146-8990-42845df67a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.223677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57617fe2-2012-4146-8990-42845df67a93 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.225181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57617fe2-2012-4146-8990-42845df67a93 None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.226775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57617fe2-2012-4146-8990-42845df67a93 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:18.228994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 134/251] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:18 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:18.235744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57617fe2-2012-4146-8990-42845df67a93 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.325732 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba12eb7-2b8b-4158-b225-9521e1795163 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.360432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:18.374672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57617fe2-2012-4146-8990-42845df67a93 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.379084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e427cf5-1b63-4551-862b-70bdbaf27d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.379533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e427cf5-1b63-4551-862b-70bdbaf27d8a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.379920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e427cf5-1b63-4551-862b-70bdbaf27d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.380201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e427cf5-1b63-4551-862b-70bdbaf27d8a None admin] PATH_INFO: `/v3/users/bbd228fcf84f40e5b0e2b77bfc7132a6` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.402778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e427cf5-1b63-4551-862b-70bdbaf27d8a None admin] RBAC: Authorizing `identity:get_user(user_id=bbd228fcf84f40e5b0e2b77bfc7132a6)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.404361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e427cf5-1b63-4551-862b-70bdbaf27d8a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:18.406122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 118/252] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:18 2022] GET /identity/v3/users/bbd228fcf84f40e5b0e2b77bfc7132a6 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:18.406896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e427cf5-1b63-4551-862b-70bdbaf27d8a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.423057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:18.433730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f846118-e19f-4871-b726-49955717ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.437074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f846118-e19f-4871-b726-49955717ad2d None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.437074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f846118-e19f-4871-b726-49955717ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.437074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f846118-e19f-4871-b726-49955717ad2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.453738 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f846118-e19f-4871-b726-49955717ad2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-3f846118-e19f-4871-b726-49955717ad2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:18.462986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:18.464210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:18.465128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 135/253] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:18.470287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35116-d6ce-43ca-9c38-ec0c7e769163 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.470593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35116-d6ce-43ca-9c38-ec0c7e769163 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.471100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35116-d6ce-43ca-9c38-ec0c7e769163 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.472747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 136/254] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:18.473514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35116-d6ce-43ca-9c38-ec0c7e769163 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.543103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e427cf5-1b63-4551-862b-70bdbaf27d8a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.590058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b1b67-6cff-4e68-a325-31b4cda61523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.590729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b1b67-6cff-4e68-a325-31b4cda61523 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.591017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b1b67-6cff-4e68-a325-31b4cda61523 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.591300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b1b67-6cff-4e68-a325-31b4cda61523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.591478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35116-d6ce-43ca-9c38-ec0c7e769163 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.592202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b1b67-6cff-4e68-a325-31b4cda61523 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=17512cd0708a4c7aa66913e0ed2c1768, user.id=e43ff791c65f46678f18240ddb15df04) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:18.592517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b1b67-6cff-4e68-a325-31b4cda61523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.594296 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b1b67-6cff-4e68-a325-31b4cda61523 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:18.602670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 119/255] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:18 2022] GET /identity/v3/role_assignments?user.id=e43ff791c65f46678f18240ddb15df04&scope.project.id=17512cd0708a4c7aa66913e0ed2c1768&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:18.603642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b1b67-6cff-4e68-a325-31b4cda61523 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.648014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e47c37-af32-4d48-9c98-30437549632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.649501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e47c37-af32-4d48-9c98-30437549632a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.649983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e47c37-af32-4d48-9c98-30437549632a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.650452 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e47c37-af32-4d48-9c98-30437549632a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.681632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:18.700909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:18.748618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b1b67-6cff-4e68-a325-31b4cda61523 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:18.765490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e47c37-af32-4d48-9c98-30437549632a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.767016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e47c37-af32-4d48-9c98-30437549632a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:18.834432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca17e43-4d95-43b4-978b-b0274b0209a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:18.835620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17e43-4d95-43b4-978b-b0274b0209a9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.836124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17e43-4d95-43b4-978b-b0274b0209a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.836597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17e43-4d95-43b4-978b-b0274b0209a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.837564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca17e43-4d95-43b4-978b-b0274b0209a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:18.838229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca17e43-4d95-43b4-978b-b0274b0209a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:18.848422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca17e43-4d95-43b4-978b-b0274b0209a9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:18.861311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 120/256] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:18.864651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ad35b-e22e-402d-a3d3-55012a12b88d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:18.864947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ad35b-e22e-402d-a3d3-55012a12b88d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:18.865227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ad35b-e22e-402d-a3d3-55012a12b88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:18.880243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 137/257] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:18.881116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e47c37-af32-4d48-9c98-30437549632a None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.891548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-951ad35b-e22e-402d-a3d3-55012a12b88d None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:18.892768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-951ad35b-e22e-402d-a3d3-55012a12b88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:18.946707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:18.984311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 121/258] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:18.985167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ad35b-e22e-402d-a3d3-55012a12b88d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:18.999272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e47c37-af32-4d48-9c98-30437549632a None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.035165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c0e6a-7ef1-47af-be8d-26750ba70f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.036179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c0e6a-7ef1-47af-be8d-26750ba70f2e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.036580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c0e6a-7ef1-47af-be8d-26750ba70f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.036811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c0e6a-7ef1-47af-be8d-26750ba70f2e None admin] PATH_INFO: `/v3/users/db1271d4ab7c4e889eb7fa897ebeb3f8` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.038023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c0e6a-7ef1-47af-be8d-26750ba70f2e None admin] RBAC: Authorizing `identity:get_user(user_id=db1271d4ab7c4e889eb7fa897ebeb3f8)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.039753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c0e6a-7ef1-47af-be8d-26750ba70f2e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.041547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 138/259] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:18 2022] GET /identity/v3/users/db1271d4ab7c4e889eb7fa897ebeb3f8 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:19.042297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c0e6a-7ef1-47af-be8d-26750ba70f2e None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.053849 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:19.097106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ad35b-e22e-402d-a3d3-55012a12b88d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.135657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab8cc5-deda-4e7c-9cb2-6655f6abc61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.136591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab8cc5-deda-4e7c-9cb2-6655f6abc61d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.136902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab8cc5-deda-4e7c-9cb2-6655f6abc61d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.137180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab8cc5-deda-4e7c-9cb2-6655f6abc61d None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.138477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab8cc5-deda-4e7c-9cb2-6655f6abc61d None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.139986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab8cc5-deda-4e7c-9cb2-6655f6abc61d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.142203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 122/260] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:18 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:19.142664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab8cc5-deda-4e7c-9cb2-6655f6abc61d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.157679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c0e6a-7ef1-47af-be8d-26750ba70f2e None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.177076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:19.197164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9ea90-3ff5-47ce-94d4-866893fbea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.198298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9ea90-3ff5-47ce-94d4-866893fbea95 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.198772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9ea90-3ff5-47ce-94d4-866893fbea95 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.199248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9ea90-3ff5-47ce-94d4-866893fbea95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.210075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9ea90-3ff5-47ce-94d4-866893fbea95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-46e9ea90-3ff5-47ce-94d4-866893fbea95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:19.218481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:19.219348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:19.220263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:19.220263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:19.220263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:19.220263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:19.220263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:19.220263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:19.220263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:19.220263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:19.220263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:19.220263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:19.220263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:19.220263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:19.222680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 139/261] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:00:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:19.223701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9ea90-3ff5-47ce-94d4-866893fbea95 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.253934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab8cc5-deda-4e7c-9cb2-6655f6abc61d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.289123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d376c0-7e19-4a93-b867-d228db0b2ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.290449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d376c0-7e19-4a93-b867-d228db0b2ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.290449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d376c0-7e19-4a93-b867-d228db0b2ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.290718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d376c0-7e19-4a93-b867-d228db0b2ff2 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.291958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d376c0-7e19-4a93-b867-d228db0b2ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.293401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d376c0-7e19-4a93-b867-d228db0b2ff2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.295305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 123/262] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:19 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:19.296100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d376c0-7e19-4a93-b867-d228db0b2ff2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.296743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:19.325152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9ea90-3ff5-47ce-94d4-866893fbea95 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.358405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926008f-c000-4691-8684-cfdf116c8a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.359502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926008f-c000-4691-8684-cfdf116c8a5a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.360236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926008f-c000-4691-8684-cfdf116c8a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.360900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926008f-c000-4691-8684-cfdf116c8a5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.361879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926008f-c000-4691-8684-cfdf116c8a5a None admin] RBAC: Adding query filter params (role.id=5cd390b79218462b9837d41be8ec8b5c, scope.project.id=17512cd0708a4c7aa66913e0ed2c1768, user.id=bbd228fcf84f40e5b0e2b77bfc7132a6) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:19.362354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926008f-c000-4691-8684-cfdf116c8a5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.364596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926008f-c000-4691-8684-cfdf116c8a5a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.371788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 140/263] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:19 2022] GET /identity/v3/role_assignments?user.id=bbd228fcf84f40e5b0e2b77bfc7132a6&scope.project.id=17512cd0708a4c7aa66913e0ed2c1768&role.id=5cd390b79218462b9837d41be8ec8b5c => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:19.377172 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926008f-c000-4691-8684-cfdf116c8a5a None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.425243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d376c0-7e19-4a93-b867-d228db0b2ff2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.468526 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:19.497309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e508e0d-aab1-4740-826f-ce23b8702ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.498959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e508e0d-aab1-4740-826f-ce23b8702ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.499653 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e508e0d-aab1-4740-826f-ce23b8702ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.500850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e508e0d-aab1-4740-826f-ce23b8702ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.503149 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e508e0d-aab1-4740-826f-ce23b8702ac7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:19.503698 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e508e0d-aab1-4740-826f-ce23b8702ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.505538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e508e0d-aab1-4740-826f-ce23b8702ac7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.524029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 124/264] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:19.534605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e508e0d-aab1-4740-826f-ce23b8702ac7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.600400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926008f-c000-4691-8684-cfdf116c8a5a None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.677834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebbf88-0cec-4769-af7e-fa9c05a3b8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.679480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebbf88-0cec-4769-af7e-fa9c05a3b8f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.679913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:19.680171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebbf88-0cec-4769-af7e-fa9c05a3b8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.680675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebbf88-0cec-4769-af7e-fa9c05a3b8f4 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768/users/db1271d4ab7c4e889eb7fa897ebeb3f8/roles/88c41930377947b7a1dc0134ba0f787b` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.685230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebbf88-0cec-4769-af7e-fa9c05a3b8f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=17512cd0708a4c7aa66913e0ed2c1768, user_id=db1271d4ab7c4e889eb7fa897ebeb3f8, role_id=88c41930377947b7a1dc0134ba0f787b)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.686905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebbf88-0cec-4769-af7e-fa9c05a3b8f4 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.708726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 141/265] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:00:19 2022] PUT /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768/users/db1271d4ab7c4e889eb7fa897ebeb3f8/roles/88c41930377947b7a1dc0134ba0f787b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:19.721530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e508e0d-aab1-4740-826f-ce23b8702ac7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.758402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1266cd-e3e9-43c3-8d04-d204195c7fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.759719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1266cd-e3e9-43c3-8d04-d204195c7fed None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.760221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1266cd-e3e9-43c3-8d04-d204195c7fed None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.760673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1266cd-e3e9-43c3-8d04-d204195c7fed None admin] PATH_INFO: `/v3/users/e43ff791c65f46678f18240ddb15df04` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:19.762189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1266cd-e3e9-43c3-8d04-d204195c7fed None admin] RBAC: Authorizing `identity:get_user(user_id=e43ff791c65f46678f18240ddb15df04)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:19.763899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1266cd-e3e9-43c3-8d04-d204195c7fed None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:19.766187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 125/266] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:19 2022] GET /identity/v3/users/e43ff791c65f46678f18240ddb15df04 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:19.772691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebbf88-0cec-4769-af7e-fa9c05a3b8f4 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:19.909061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebbf88-0cec-4769-af7e-fa9c05a3b8f4 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:19.910635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:19.961704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982929e2-354d-4b5e-a013-dfee21f17c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:19.962286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982929e2-354d-4b5e-a013-dfee21f17c30 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:19.962566 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982929e2-354d-4b5e-a013-dfee21f17c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:19.962845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982929e2-354d-4b5e-a013-dfee21f17c30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:20.043294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982929e2-354d-4b5e-a013-dfee21f17c30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:20.044869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982929e2-354d-4b5e-a013-dfee21f17c30 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:20.163327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 142/267] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:20.169682 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1266cd-e3e9-43c3-8d04-d204195c7fed None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:20.303306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1266cd-e3e9-43c3-8d04-d204195c7fed None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:20.331313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:20.336946 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158026a0-ef4e-4542-8f30-70e34537a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:20.337886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158026a0-ef4e-4542-8f30-70e34537a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:20.338518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158026a0-ef4e-4542-8f30-70e34537a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:20.339071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158026a0-ef4e-4542-8f30-70e34537a6e8 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:20.340367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158026a0-ef4e-4542-8f30-70e34537a6e8 None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:20.342169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158026a0-ef4e-4542-8f30-70e34537a6e8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:20.344474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 126/268] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:20 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:20.350202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982929e2-354d-4b5e-a013-dfee21f17c30 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:20.352441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:20.450140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982929e2-354d-4b5e-a013-dfee21f17c30 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:20.484658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797b4c1-58d5-462d-8a51-919587e70a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:20.485322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797b4c1-58d5-462d-8a51-919587e70a49 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:20.485817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797b4c1-58d5-462d-8a51-919587e70a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:20.486091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797b4c1-58d5-462d-8a51-919587e70a49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:20.486938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797b4c1-58d5-462d-8a51-919587e70a49 None admin] RBAC: Adding query filter params (role.id=47a961686ccc4c6a8bb05e0f3fe5ffba, scope.project.id=17512cd0708a4c7aa66913e0ed2c1768, user.id=e43ff791c65f46678f18240ddb15df04) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:20.487250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797b4c1-58d5-462d-8a51-919587e70a49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:20.488738 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797b4c1-58d5-462d-8a51-919587e70a49 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:20.494562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 143/269] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:20 2022] GET /identity/v3/role_assignments?user.id=e43ff791c65f46678f18240ddb15df04&scope.project.id=17512cd0708a4c7aa66913e0ed2c1768&role.id=47a961686ccc4c6a8bb05e0f3fe5ffba => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:20.833629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488a3d2-63ae-4491-b4ef-3968d7aeb8d3 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:20.834173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488a3d2-63ae-4491-b4ef-3968d7aeb8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:20.834173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488a3d2-63ae-4491-b4ef-3968d7aeb8d3 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:20.835985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 127/270] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:20.840677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45a5a2-3bed-4941-b32c-a509d5e18a04 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:20.841095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45a5a2-3bed-4941-b32c-a509d5e18a04 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:20.841286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45a5a2-3bed-4941-b32c-a509d5e18a04 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:20.842837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 144/271] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:20.844843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7260b89-8832-4aaf-a807-34ad4c89cb9f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:20.845139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7260b89-8832-4aaf-a807-34ad4c89cb9f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:20.845417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7260b89-8832-4aaf-a807-34ad4c89cb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:20.848749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ca133-001f-46ae-9f7e-1ec1b9954527 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:20.849033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ca133-001f-46ae-9f7e-1ec1b9954527 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:20.849353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ca133-001f-46ae-9f7e-1ec1b9954527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:20.867275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-a95ca133-001f-46ae-9f7e-1ec1b9954527 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:20.868853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-a95ca133-001f-46ae-9f7e-1ec1b9954527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:20.870111 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f7260b89-8832-4aaf-a807-34ad4c89cb9f None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:20.871665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f7260b89-8832-4aaf-a807-34ad4c89cb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:20.946830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:20.959648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 145/272] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:20.970029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 128/273] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:20.982838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ca133-001f-46ae-9f7e-1ec1b9954527 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:20.994825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7260b89-8832-4aaf-a807-34ad4c89cb9f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:21.112832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ca133-001f-46ae-9f7e-1ec1b9954527 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:21.115699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7260b89-8832-4aaf-a807-34ad4c89cb9f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:21.145867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:21.155526 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe63cf-bb10-48f6-b371-013c2569b0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:21.156675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe63cf-bb10-48f6-b371-013c2569b0ad None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:21.157157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe63cf-bb10-48f6-b371-013c2569b0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:21.157628 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe63cf-bb10-48f6-b371-013c2569b0ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:21.158472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94c3f4-2afe-43fd-8a40-27adc2fe2fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:21.159339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94c3f4-2afe-43fd-8a40-27adc2fe2fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:21.159672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94c3f4-2afe-43fd-8a40-27adc2fe2fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:21.159959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94c3f4-2afe-43fd-8a40-27adc2fe2fb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:21.161775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94c3f4-2afe-43fd-8a40-27adc2fe2fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:21.163254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94c3f4-2afe-43fd-8a40-27adc2fe2fb2 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:21.167644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 146/274] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:21.171833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94c3f4-2afe-43fd-8a40-27adc2fe2fb2 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:21.174807 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe63cf-bb10-48f6-b371-013c2569b0ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-f1fe63cf-bb10-48f6-b371-013c2569b0ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:21.183746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:21.184676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:21.185480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:21.185480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:21.185480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:21.185480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:21.185480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:21.185480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:21.185480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:21.185480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:21.185480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:21.185480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:21.185480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:21.185480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:21.191651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 129/275] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:21.194289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe63cf-bb10-48f6-b371-013c2569b0ad None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:21.246968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:21.288368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94c3f4-2afe-43fd-8a40-27adc2fe2fb2 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:21.328915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfb2c4-ce41-47f6-8df0-6a339325c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:21.329960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfb2c4-ce41-47f6-8df0-6a339325c454 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:21.330466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe63cf-bb10-48f6-b371-013c2569b0ad None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:21.330774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfb2c4-ce41-47f6-8df0-6a339325c454 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:21.331250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfb2c4-ce41-47f6-8df0-6a339325c454 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:21.332252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfb2c4-ce41-47f6-8df0-6a339325c454 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:21.334005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfb2c4-ce41-47f6-8df0-6a339325c454 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:21.359704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 147/276] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:00:21 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:00:21.379864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05f9c5-1adc-42c3-b013-bd4d80511af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:21.380924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05f9c5-1adc-42c3-b013-bd4d80511af8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:21.381468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05f9c5-1adc-42c3-b013-bd4d80511af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:21.381945 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05f9c5-1adc-42c3-b013-bd4d80511af8 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:21.383068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05f9c5-1adc-42c3-b013-bd4d80511af8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:21.383636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05f9c5-1adc-42c3-b013-bd4d80511af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:21.385363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05f9c5-1adc-42c3-b013-bd4d80511af8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:21.396365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 130/277] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:21.402678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfb2c4-ce41-47f6-8df0-6a339325c454 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:21.532705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfb2c4-ce41-47f6-8df0-6a339325c454 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:21.554857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:21.574939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf093a-563c-4da5-8229-7ec0b48fa09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:21.576734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf093a-563c-4da5-8229-7ec0b48fa09d None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:21.576734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf093a-563c-4da5-8229-7ec0b48fa09d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:21.576734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf093a-563c-4da5-8229-7ec0b48fa09d None admin] PATH_INFO: `/v3/users/4b0fb5c96753485793f93ab987aed130` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:21.590985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf093a-563c-4da5-8229-7ec0b48fa09d None admin] RBAC: Authorizing `identity:get_user(user_id=4b0fb5c96753485793f93ab987aed130)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:21.592502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf093a-563c-4da5-8229-7ec0b48fa09d None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:21.594419 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 148/278] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:21 2022] GET /identity/v3/users/4b0fb5c96753485793f93ab987aed130 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:21.599991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05f9c5-1adc-42c3-b013-bd4d80511af8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:21.656644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:21.713943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05f9c5-1adc-42c3-b013-bd4d80511af8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:21.751550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad84f48-4eee-4c34-9888-94df48c8849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:21.752280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad84f48-4eee-4c34-9888-94df48c8849b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:21.752567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad84f48-4eee-4c34-9888-94df48c8849b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:21.752844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad84f48-4eee-4c34-9888-94df48c8849b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:21.753698 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad84f48-4eee-4c34-9888-94df48c8849b None admin] RBAC: Adding query filter params (role.id=88c41930377947b7a1dc0134ba0f787b, user.id=4b0fb5c96753485793f93ab987aed130, scope.system=all) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:21.754013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad84f48-4eee-4c34-9888-94df48c8849b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:21.755455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad84f48-4eee-4c34-9888-94df48c8849b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:21.760754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 131/279] 10.222.0.24 () {56 vars in 1308 bytes} [Wed May 25 15:00:21 2022] GET /identity/v3/role_assignments?user.id=4b0fb5c96753485793f93ab987aed130&scope.system=all&role.id=88c41930377947b7a1dc0134ba0f787b => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:21.833263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e306906-b52e-4a5b-ac8d-cfe9635ebc3c None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:21.833601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e306906-b52e-4a5b-ac8d-cfe9635ebc3c None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:21.833828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e306906-b52e-4a5b-ac8d-cfe9635ebc3c None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:21.835266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 149/280] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:21.841049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f690e05-2c11-4296-9197-44e192eaa5ef None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:21.841556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f690e05-2c11-4296-9197-44e192eaa5ef None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:21.841660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f690e05-2c11-4296-9197-44e192eaa5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:21.860120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5f690e05-2c11-4296-9197-44e192eaa5ef None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:21.861321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5f690e05-2c11-4296-9197-44e192eaa5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:21.940837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 132/281] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:21.964505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e306906-b52e-4a5b-ac8d-cfe9635ebc3c None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:22.081193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e306906-b52e-4a5b-ac8d-cfe9635ebc3c None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:22.124837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd6766-401d-44dc-b22f-5ec953d070b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:22.125650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd6766-401d-44dc-b22f-5ec953d070b5 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:22.125934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd6766-401d-44dc-b22f-5ec953d070b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:22.126209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd6766-401d-44dc-b22f-5ec953d070b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:22.136796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd6766-401d-44dc-b22f-5ec953d070b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-71bd6766-401d-44dc-b22f-5ec953d070b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:22.144769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:22.145679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:22.146909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 150/282] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:22.152144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f690e05-2c11-4296-9197-44e192eaa5ef None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:22.210885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:22.273256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f690e05-2c11-4296-9197-44e192eaa5ef None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:22.317116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a739c2d-d7dc-4970-8370-660ef0a1efe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:22.317813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a739c2d-d7dc-4970-8370-660ef0a1efe7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:22.318109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a739c2d-d7dc-4970-8370-660ef0a1efe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:22.318391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a739c2d-d7dc-4970-8370-660ef0a1efe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:22.319166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a739c2d-d7dc-4970-8370-660ef0a1efe7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:22.319476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a739c2d-d7dc-4970-8370-660ef0a1efe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:22.320938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a739c2d-d7dc-4970-8370-660ef0a1efe7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:22.336945 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 133/283] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:22.342365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd6766-401d-44dc-b22f-5ec953d070b5 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:22.403769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:22.466258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ba1e8-8bbf-4ce0-b3b0-5590c5459dd0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:22.466533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ba1e8-8bbf-4ce0-b3b0-5590c5459dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:22.466755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ba1e8-8bbf-4ce0-b3b0-5590c5459dd0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:22.468959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 134/284] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:00:22.479914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95a51f-0536-4624-98ca-fe9ce076ac29 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:22.480208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95a51f-0536-4624-98ca-fe9ce076ac29 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:22.480494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95a51f-0536-4624-98ca-fe9ce076ac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:22.494589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd6766-401d-44dc-b22f-5ec953d070b5 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:22.516401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5f95a51f-0536-4624-98ca-fe9ce076ac29 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:22.519304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5f95a51f-0536-4624-98ca-fe9ce076ac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:22.547492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d065a-806d-4ccc-b481-b0019b99f0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:22.548774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d065a-806d-4ccc-b481-b0019b99f0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:22.549245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d065a-806d-4ccc-b481-b0019b99f0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:22.549728 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d065a-806d-4ccc-b481-b0019b99f0e0 None admin] PATH_INFO: `/v3/users/bbd228fcf84f40e5b0e2b77bfc7132a6` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:22.551132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d065a-806d-4ccc-b481-b0019b99f0e0 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd228fcf84f40e5b0e2b77bfc7132a6)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:22.553027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d065a-806d-4ccc-b481-b0019b99f0e0 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:22.555520 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 151/285] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:22 2022] GET /identity/v3/users/bbd228fcf84f40e5b0e2b77bfc7132a6 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:22.568597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d065a-806d-4ccc-b481-b0019b99f0e0 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:22.617140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 135/286] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:22.652830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95a51f-0536-4624-98ca-fe9ce076ac29 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:22.704795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:22.767297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95a51f-0536-4624-98ca-fe9ce076ac29 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:22.774953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d065a-806d-4ccc-b481-b0019b99f0e0 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:22.792479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:22.806085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988b9f2-d1ef-499e-991c-c9e6cbf19332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:22.806901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988b9f2-d1ef-499e-991c-c9e6cbf19332 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:22.807180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988b9f2-d1ef-499e-991c-c9e6cbf19332 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:22.807451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988b9f2-d1ef-499e-991c-c9e6cbf19332 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:22.830146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988b9f2-d1ef-499e-991c-c9e6cbf19332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-5988b9f2-d1ef-499e-991c-c9e6cbf19332 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:22.839933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:22.840815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:22.842054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 136/287] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:22.846962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2ce8c-0b55-4b75-8aa1-cf6ba1b16b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:22.848290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2ce8c-0b55-4b75-8aa1-cf6ba1b16b6d None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:22.848574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2ce8c-0b55-4b75-8aa1-cf6ba1b16b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:22.848846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2ce8c-0b55-4b75-8aa1-cf6ba1b16b6d None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:22.850585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2ce8c-0b55-4b75-8aa1-cf6ba1b16b6d None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:22.852165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2ce8c-0b55-4b75-8aa1-cf6ba1b16b6d None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:22.853963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 152/288] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:22 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:22.854279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988b9f2-d1ef-499e-991c-c9e6cbf19332 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:22.859709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2ce8c-0b55-4b75-8aa1-cf6ba1b16b6d None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:23.017942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2ce8c-0b55-4b75-8aa1-cf6ba1b16b6d None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:23.056529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:23.065109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988b9f2-d1ef-499e-991c-c9e6cbf19332 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:23.107434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5106b39-921b-4ec1-b260-edc558766876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:23.107941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1327e-9f7d-4ebc-be62-a7ba105ceed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:23.108387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5106b39-921b-4ec1-b260-edc558766876 None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:23.108678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5106b39-921b-4ec1-b260-edc558766876 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:23.108779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1327e-9f7d-4ebc-be62-a7ba105ceed5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:23.109041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5106b39-921b-4ec1-b260-edc558766876 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768/users/bbd228fcf84f40e5b0e2b77bfc7132a6/roles/5cd390b79218462b9837d41be8ec8b5c` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:23.109138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1327e-9f7d-4ebc-be62-a7ba105ceed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:23.109322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1327e-9f7d-4ebc-be62-a7ba105ceed5 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:23.110273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1327e-9f7d-4ebc-be62-a7ba105ceed5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:23.110584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1327e-9f7d-4ebc-be62-a7ba105ceed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:23.111061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5106b39-921b-4ec1-b260-edc558766876 None admin] RBAC: Authorizing `identity:create_grant(project_id=17512cd0708a4c7aa66913e0ed2c1768, user_id=bbd228fcf84f40e5b0e2b77bfc7132a6, role_id=5cd390b79218462b9837d41be8ec8b5c)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:23.112015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1327e-9f7d-4ebc-be62-a7ba105ceed5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:23.112563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5106b39-921b-4ec1-b260-edc558766876 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:23.121755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 137/289] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:23.128183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1327e-9f7d-4ebc-be62-a7ba105ceed5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:23.135726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 153/290] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:00:22 2022] PUT /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768/users/bbd228fcf84f40e5b0e2b77bfc7132a6/roles/5cd390b79218462b9837d41be8ec8b5c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:23.243197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1327e-9f7d-4ebc-be62-a7ba105ceed5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:23.280795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67526a-0d08-4cf2-b68f-6ad2fce29e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:23.281695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67526a-0d08-4cf2-b68f-6ad2fce29e42 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:23.281978 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67526a-0d08-4cf2-b68f-6ad2fce29e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:23.282261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67526a-0d08-4cf2-b68f-6ad2fce29e42 None admin] PATH_INFO: `/v3/users/db1271d4ab7c4e889eb7fa897ebeb3f8` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:23.283445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67526a-0d08-4cf2-b68f-6ad2fce29e42 None admin] RBAC: Authorizing `identity:get_user(user_id=db1271d4ab7c4e889eb7fa897ebeb3f8)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:23.285033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67526a-0d08-4cf2-b68f-6ad2fce29e42 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:23.286970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 138/291] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:23 2022] GET /identity/v3/users/db1271d4ab7c4e889eb7fa897ebeb3f8 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:23.292485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5106b39-921b-4ec1-b260-edc558766876 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:23.352331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:23.436938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5106b39-921b-4ec1-b260-edc558766876 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:23.472464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b994a9-3035-4fde-b1b6-3265d3ee750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:23.473207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b994a9-3035-4fde-b1b6-3265d3ee750f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:23.473504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b994a9-3035-4fde-b1b6-3265d3ee750f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:23.473781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b994a9-3035-4fde-b1b6-3265d3ee750f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:23.541593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b994a9-3035-4fde-b1b6-3265d3ee750f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:23.543108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b994a9-3035-4fde-b1b6-3265d3ee750f None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:23.578593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:23.647684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 154/292] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:23.653315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67526a-0d08-4cf2-b68f-6ad2fce29e42 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:23.695265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:23.771699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67526a-0d08-4cf2-b68f-6ad2fce29e42 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:23.811071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98b44-5e72-4132-bc3e-a4e277478c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:23.811900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98b44-5e72-4132-bc3e-a4e277478c38 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:23.812215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98b44-5e72-4132-bc3e-a4e277478c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:23.812593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98b44-5e72-4132-bc3e-a4e277478c38 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:23.813790 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e98b44-5e72-4132-bc3e-a4e277478c38 None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:23.815299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e98b44-5e72-4132-bc3e-a4e277478c38 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:23.817092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 139/293] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:23 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:23.823019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b994a9-3035-4fde-b1b6-3265d3ee750f None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:23.930911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b994a9-3035-4fde-b1b6-3265d3ee750f None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:23.971068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682533c5-4dbd-4dda-b4f9-cce8e0e197e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:23.971771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682533c5-4dbd-4dda-b4f9-cce8e0e197e9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:23.972057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682533c5-4dbd-4dda-b4f9-cce8e0e197e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:23.972338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682533c5-4dbd-4dda-b4f9-cce8e0e197e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:23.973198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682533c5-4dbd-4dda-b4f9-cce8e0e197e9 None admin] RBAC: Adding query filter params (role.id=88c41930377947b7a1dc0134ba0f787b, scope.project.id=17512cd0708a4c7aa66913e0ed2c1768, user.id=db1271d4ab7c4e889eb7fa897ebeb3f8) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:23.973511 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682533c5-4dbd-4dda-b4f9-cce8e0e197e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:23.974965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682533c5-4dbd-4dda-b4f9-cce8e0e197e9 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:23.979865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:23.984807 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 155/294] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:23 2022] GET /identity/v3/role_assignments?user.id=db1271d4ab7c4e889eb7fa897ebeb3f8&scope.project.id=17512cd0708a4c7aa66913e0ed2c1768&role.id=88c41930377947b7a1dc0134ba0f787b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:24.420736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a5f4d-6a7c-4b38-85f4-afa2e3637cd0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:24.421463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a5f4d-6a7c-4b38-85f4-afa2e3637cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:24.421463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a5f4d-6a7c-4b38-85f4-afa2e3637cd0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.423071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 140/295] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:24.428395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c889be0-33f6-424d-9540-2be241416469 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:24.428910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c889be0-33f6-424d-9540-2be241416469 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:24.429068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c889be0-33f6-424d-9540-2be241416469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.449175 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-3c889be0-33f6-424d-9540-2be241416469 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:24.449471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-3c889be0-33f6-424d-9540-2be241416469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:24.512807 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecddbd5-a98d-4fd7-8936-a8720e009fdf None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:24.513187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecddbd5-a98d-4fd7-8936-a8720e009fdf None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:24.513363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecddbd5-a98d-4fd7-8936-a8720e009fdf None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.515036 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 141/296] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:00:24.521331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b472d-4311-424f-a960-900ae50cce45 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:24.521678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b472d-4311-424f-a960-900ae50cce45 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:24.521888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b472d-4311-424f-a960-900ae50cce45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.536841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 156/297] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:24.543596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f86b472d-4311-424f-a960-900ae50cce45 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:24.544802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f86b472d-4311-424f-a960-900ae50cce45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:24.560247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c889be0-33f6-424d-9540-2be241416469 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:24.633167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 142/298] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:24.636977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb1db2-b6cd-48fb-acec-74fa0392eb99 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:24.637469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb1db2-b6cd-48fb-acec-74fa0392eb99 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:24.637935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb1db2-b6cd-48fb-acec-74fa0392eb99 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.644691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 143/299] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:24.646528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12113286-f83f-4427-9d5e-fd73f2b80ac1 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:24.647253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12113286-f83f-4427-9d5e-fd73f2b80ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:24.647748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12113286-f83f-4427-9d5e-fd73f2b80ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.666829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-12113286-f83f-4427-9d5e-fd73f2b80ac1 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:24.668046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-12113286-f83f-4427-9d5e-fd73f2b80ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:24.668558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c889be0-33f6-424d-9540-2be241416469 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:24.685736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:24.699644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:24.707823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7e608-f3b0-403f-a10a-d91dea79e6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:24.708621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7e608-f3b0-403f-a10a-d91dea79e6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:24.709309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7e608-f3b0-403f-a10a-d91dea79e6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:24.709587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7e608-f3b0-403f-a10a-d91dea79e6c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.721612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7e608-f3b0-403f-a10a-d91dea79e6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-7ec7e608-f3b0-403f-a10a-d91dea79e6c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:24.729903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:24.730793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:24.732141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:24.732141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:24.732141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:24.732141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:24.732141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:24.732141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:24.732141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:24.732141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:24.732141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:24.732141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:24.732141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:24.732141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:24.736004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 157/300] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:24.736868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7e608-f3b0-403f-a10a-d91dea79e6c8 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:24.737625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 144/301] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:24.738463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12113286-f83f-4427-9d5e-fd73f2b80ac1 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:24.843715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12113286-f83f-4427-9d5e-fd73f2b80ac1 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:24.852963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7e608-f3b0-403f-a10a-d91dea79e6c8 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:24.880361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae5ac9-9c25-479b-a810-3366e6b5cfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:24.881312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae5ac9-9c25-479b-a810-3366e6b5cfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:24.881602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae5ac9-9c25-479b-a810-3366e6b5cfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:24.881885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae5ac9-9c25-479b-a810-3366e6b5cfb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.882796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae5ac9-9c25-479b-a810-3366e6b5cfb9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:24.883415 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae5ac9-9c25-479b-a810-3366e6b5cfb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:24.885116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae5ac9-9c25-479b-a810-3366e6b5cfb9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:24.888161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4db6b3-897e-4806-9d1a-62e4a683dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:24.888974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db6b3-897e-4806-9d1a-62e4a683dbef None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:24.889259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db6b3-897e-4806-9d1a-62e4a683dbef None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:24.889533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db6b3-897e-4806-9d1a-62e4a683dbef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:24.894066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 145/302] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:24.894702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae5ac9-9c25-479b-a810-3366e6b5cfb9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:24.903027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4db6b3-897e-4806-9d1a-62e4a683dbef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-8a4db6b3-897e-4806-9d1a-62e4a683dbef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:24.911873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:24.912739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:24.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 158/303] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:24.914227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4db6b3-897e-4806-9d1a-62e4a683dbef None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:24.920239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:24.962934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:25.003620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae5ac9-9c25-479b-a810-3366e6b5cfb9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:25.018055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4db6b3-897e-4806-9d1a-62e4a683dbef None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:25.044266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417bee2-7eb3-415c-b512-c554989d4e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:25.045073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417bee2-7eb3-415c-b512-c554989d4e22 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:25.045356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417bee2-7eb3-415c-b512-c554989d4e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:25.045860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417bee2-7eb3-415c-b512-c554989d4e22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:25.046834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417bee2-7eb3-415c-b512-c554989d4e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:25.048565 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417bee2-7eb3-415c-b512-c554989d4e22 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:25.050276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 146/304] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:25.051067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417bee2-7eb3-415c-b512-c554989d4e22 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:25.062259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49de13-94d6-4fd9-a773-ce98c5ed062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:25.063173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49de13-94d6-4fd9-a773-ce98c5ed062b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:25.063578 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49de13-94d6-4fd9-a773-ce98c5ed062b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:25.063763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49de13-94d6-4fd9-a773-ce98c5ed062b None admin] PATH_INFO: `/v3/users/80ab15aa4b2b4aa6b0a0b6b9cf84780b` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:25.078805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49de13-94d6-4fd9-a773-ce98c5ed062b None admin] RBAC: Authorizing `identity:get_user(user_id=80ab15aa4b2b4aa6b0a0b6b9cf84780b)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:25.080290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49de13-94d6-4fd9-a773-ce98c5ed062b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:25.082135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 159/305] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:24 2022] GET /identity/v3/users/80ab15aa4b2b4aa6b0a0b6b9cf84780b => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:25.087255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49de13-94d6-4fd9-a773-ce98c5ed062b None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:25.148239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:25.166336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417bee2-7eb3-415c-b512-c554989d4e22 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:25.192563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49de13-94d6-4fd9-a773-ce98c5ed062b None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:25.201140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce969ad8-d7c6-46ba-bac7-f40b52210762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:25.201305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:25.201824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce969ad8-d7c6-46ba-bac7-f40b52210762 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:25.202219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce969ad8-d7c6-46ba-bac7-f40b52210762 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:25.202453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce969ad8-d7c6-46ba-bac7-f40b52210762 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:25.203247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce969ad8-d7c6-46ba-bac7-f40b52210762 None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:25.203611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce969ad8-d7c6-46ba-bac7-f40b52210762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:25.205031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce969ad8-d7c6-46ba-bac7-f40b52210762 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:25.213541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 147/306] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:25.214392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce969ad8-d7c6-46ba-bac7-f40b52210762 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:25.234260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b055a-8c8a-4bed-9103-084bc09a9a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:25.235124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b055a-8c8a-4bed-9103-084bc09a9a15 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:25.235368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b055a-8c8a-4bed-9103-084bc09a9a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:25.235677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b055a-8c8a-4bed-9103-084bc09a9a15 None admin] PATH_INFO: `/v3/groups` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:25.236381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b055a-8c8a-4bed-9103-084bc09a9a15 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:25.237824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b055a-8c8a-4bed-9103-084bc09a9a15 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:25.256006 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 160/307] 10.222.0.24 () {60 vars in 1134 bytes} [Wed May 25 15:00:25 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:25.257145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b055a-8c8a-4bed-9103-084bc09a9a15 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:25.332241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce969ad8-d7c6-46ba-bac7-f40b52210762 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:25.372648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839854f0-d7be-4116-ab6a-1c385735f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:25.373334 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839854f0-d7be-4116-ab6a-1c385735f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:25.373624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839854f0-d7be-4116-ab6a-1c385735f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:25.373957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839854f0-d7be-4116-ab6a-1c385735f7b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:25.374830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839854f0-d7be-4116-ab6a-1c385735f7b4 None admin] RBAC: Adding query filter params (role.id=5cd390b79218462b9837d41be8ec8b5c, user.id=80ab15aa4b2b4aa6b0a0b6b9cf84780b, scope.system=all) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:25.375465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839854f0-d7be-4116-ab6a-1c385735f7b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:25.377083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839854f0-d7be-4116-ab6a-1c385735f7b4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:25.391602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 148/308] 10.222.0.24 () {56 vars in 1308 bytes} [Wed May 25 15:00:25 2022] GET /identity/v3/role_assignments?user.id=80ab15aa4b2b4aa6b0a0b6b9cf84780b&scope.system=all&role.id=5cd390b79218462b9837d41be8ec8b5c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:25.406907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b055a-8c8a-4bed-9103-084bc09a9a15 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:25.458768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9824696-c179-4911-867e-f452374d46e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:25.460572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9824696-c179-4911-867e-f452374d46e9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:25.461049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9824696-c179-4911-867e-f452374d46e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:25.461504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9824696-c179-4911-867e-f452374d46e9 None admin] PATH_INFO: `/v3/users/4b0fb5c96753485793f93ab987aed130` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:25.463144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9824696-c179-4911-867e-f452374d46e9 None admin] RBAC: Authorizing `identity:get_user(user_id=4b0fb5c96753485793f93ab987aed130)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:25.465022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9824696-c179-4911-867e-f452374d46e9 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:25.467321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 161/309] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:25 2022] GET /identity/v3/users/4b0fb5c96753485793f93ab987aed130 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:25.473595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839854f0-d7be-4116-ab6a-1c385735f7b4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:25.489905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:25.593662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839854f0-d7be-4116-ab6a-1c385735f7b4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:25.629051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0250f40-1577-42c2-a44f-6596dc2b78d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:25.629937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0250f40-1577-42c2-a44f-6596dc2b78d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:25.630222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0250f40-1577-42c2-a44f-6596dc2b78d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:25.630501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0250f40-1577-42c2-a44f-6596dc2b78d9 None admin] PATH_INFO: `/v3/system/users/4b0fb5c96753485793f93ab987aed130/roles/88c41930377947b7a1dc0134ba0f787b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:25.632030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0250f40-1577-42c2-a44f-6596dc2b78d9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4b0fb5c96753485793f93ab987aed130, role_id=88c41930377947b7a1dc0134ba0f787b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:25.633432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0250f40-1577-42c2-a44f-6596dc2b78d9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:25.645419 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 149/310] 10.222.0.24 () {58 vars in 1334 bytes} [Wed May 25 15:00:25 2022] PUT /identity/v3/system/users/4b0fb5c96753485793f93ab987aed130/roles/88c41930377947b7a1dc0134ba0f787b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:25.741648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeecca-df68-4a97-83b3-d614e687efdd None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:25.741861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeecca-df68-4a97-83b3-d614e687efdd None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:25.742144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeecca-df68-4a97-83b3-d614e687efdd None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:25.743940 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 162/311] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:25.749836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b98f77-31d5-493a-8659-3caa90258b60 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:25.750132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b98f77-31d5-493a-8659-3caa90258b60 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:25.750736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b98f77-31d5-493a-8659-3caa90258b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:25.769226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b8b98f77-31d5-493a-8659-3caa90258b60 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:25.770449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b8b98f77-31d5-493a-8659-3caa90258b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:25.844484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 150/312] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:25.868026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeecca-df68-4a97-83b3-d614e687efdd None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:25.904338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:25.974859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeecca-df68-4a97-83b3-d614e687efdd None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:26.010469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aec3fd-5d2b-4e05-a633-0096d6a511bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:26.011625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aec3fd-5d2b-4e05-a633-0096d6a511bc None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:26.012073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aec3fd-5d2b-4e05-a633-0096d6a511bc None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:26.012489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aec3fd-5d2b-4e05-a633-0096d6a511bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:26.023809 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aec3fd-5d2b-4e05-a633-0096d6a511bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-95aec3fd-5d2b-4e05-a633-0096d6a511bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:26.032169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:26.033280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:26.034275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:26.034275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:26.034275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:26.034275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:26.034275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:26.034275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:26.034275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:26.034275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:26.034275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:26.034275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:26.034275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:26.034275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:26.036784 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 163/313] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:26.044421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b98f77-31d5-493a-8659-3caa90258b60 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:26.045748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:26.150521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b98f77-31d5-493a-8659-3caa90258b60 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:26.190381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea590ba-b07d-4a46-b4c4-5c79c962ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:26.191347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea590ba-b07d-4a46-b4c4-5c79c962ae31 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:26.191802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea590ba-b07d-4a46-b4c4-5c79c962ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:26.192220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea590ba-b07d-4a46-b4c4-5c79c962ae31 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:26.193124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea590ba-b07d-4a46-b4c4-5c79c962ae31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:26.193573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea590ba-b07d-4a46-b4c4-5c79c962ae31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:26.195121 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea590ba-b07d-4a46-b4c4-5c79c962ae31 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:26.204223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 151/314] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:26.209625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aec3fd-5d2b-4e05-a633-0096d6a511bc None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:26.312846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:26.321946 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aec3fd-5d2b-4e05-a633-0096d6a511bc None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:26.356125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373dcee-a905-4f53-be73-c75b82a268f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:26.357237 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373dcee-a905-4f53-be73-c75b82a268f3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:26.357669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373dcee-a905-4f53-be73-c75b82a268f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:26.358089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373dcee-a905-4f53-be73-c75b82a268f3 None admin] PATH_INFO: `/v3/users/bbd228fcf84f40e5b0e2b77bfc7132a6` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:26.359416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373dcee-a905-4f53-be73-c75b82a268f3 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd228fcf84f40e5b0e2b77bfc7132a6)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:26.361114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373dcee-a905-4f53-be73-c75b82a268f3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:26.363204 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 164/315] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:26 2022] GET /identity/v3/users/bbd228fcf84f40e5b0e2b77bfc7132a6 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:26.368666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea590ba-b07d-4a46-b4c4-5c79c962ae31 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:26.442635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:26.486243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea590ba-b07d-4a46-b4c4-5c79c962ae31 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:26.520229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530054d-8358-4a20-bb3a-cb36de12fd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:26.520892 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530054d-8358-4a20-bb3a-cb36de12fd9c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:26.521177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530054d-8358-4a20-bb3a-cb36de12fd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:26.521457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530054d-8358-4a20-bb3a-cb36de12fd9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:26.589292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530054d-8358-4a20-bb3a-cb36de12fd9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:26.590757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530054d-8358-4a20-bb3a-cb36de12fd9c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:26.655928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:26.691546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 152/316] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:26.696828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373dcee-a905-4f53-be73-c75b82a268f3 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:26.801147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373dcee-a905-4f53-be73-c75b82a268f3 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:26.835306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1848-0c77-4b60-a658-3647fb19f8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:26.836771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1848-0c77-4b60-a658-3647fb19f8ae None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:26.837256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1848-0c77-4b60-a658-3647fb19f8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:26.837732 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1848-0c77-4b60-a658-3647fb19f8ae None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:26.839130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa1848-0c77-4b60-a658-3647fb19f8ae None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:26.841162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa1848-0c77-4b60-a658-3647fb19f8ae None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:26.843440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 165/317] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:26 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:26.855603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530054d-8358-4a20-bb3a-cb36de12fd9c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:26.952410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530054d-8358-4a20-bb3a-cb36de12fd9c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:26.987344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46983424-b442-4ef2-b44c-3e1e897f297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:26.988039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983424-b442-4ef2-b44c-3e1e897f297c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:26.988325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983424-b442-4ef2-b44c-3e1e897f297c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:26.988600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46983424-b442-4ef2-b44c-3e1e897f297c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:26.989452 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46983424-b442-4ef2-b44c-3e1e897f297c None admin] RBAC: Adding query filter params (role.id=5cd390b79218462b9837d41be8ec8b5c, scope.project.id=17512cd0708a4c7aa66913e0ed2c1768, user.id=bbd228fcf84f40e5b0e2b77bfc7132a6) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:26.989763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46983424-b442-4ef2-b44c-3e1e897f297c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:26.991218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46983424-b442-4ef2-b44c-3e1e897f297c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:26.998038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 153/318] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:26 2022] GET /identity/v3/role_assignments?user.id=bbd228fcf84f40e5b0e2b77bfc7132a6&scope.project.id=17512cd0708a4c7aa66913e0ed2c1768&role.id=5cd390b79218462b9837d41be8ec8b5c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:27.523583 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2fc72-3931-49b6-9fd0-2813e1c208da None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.523932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2fc72-3931-49b6-9fd0-2813e1c208da None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.524145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2fc72-3931-49b6-9fd0-2813e1c208da None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.525530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 166/319] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:27.531035 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871863a-d1a6-45c3-b384-79f99d0e509c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.531501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871863a-d1a6-45c3-b384-79f99d0e509c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.531601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871863a-d1a6-45c3-b384-79f99d0e509c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.549008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9871863a-d1a6-45c3-b384-79f99d0e509c None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:27.550226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9871863a-d1a6-45c3-b384-79f99d0e509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:27.579928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:27.627434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 154/320] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:27.649193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2fc72-3931-49b6-9fd0-2813e1c208da None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:27.681083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:27.748783 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de4a17-7688-463c-be37-214eeb4e884d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.749050 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de4a17-7688-463c-be37-214eeb4e884d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.749315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de4a17-7688-463c-be37-214eeb4e884d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.750985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 155/321] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:27.754818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2fc72-3931-49b6-9fd0-2813e1c208da None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:27.756256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ffb25-4719-4222-8d66-5fddd205d048 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.756549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ffb25-4719-4222-8d66-5fddd205d048 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.756832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ffb25-4719-4222-8d66-5fddd205d048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.773984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-543ffb25-4719-4222-8d66-5fddd205d048 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:27.775250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-543ffb25-4719-4222-8d66-5fddd205d048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:27.794239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75bfe7-50e8-4d46-91d0-1c2a2245a63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:27.795413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75bfe7-50e8-4d46-91d0-1c2a2245a63e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.795803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75bfe7-50e8-4d46-91d0-1c2a2245a63e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.796206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75bfe7-50e8-4d46-91d0-1c2a2245a63e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.797566 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75bfe7-50e8-4d46-91d0-1c2a2245a63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:27.799089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75bfe7-50e8-4d46-91d0-1c2a2245a63e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:27.801077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 167/322] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:27.806567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75bfe7-50e8-4d46-91d0-1c2a2245a63e None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:27.856844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 156/323] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:27.879346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ffb25-4719-4222-8d66-5fddd205d048 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:27.905133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:27.909944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75bfe7-50e8-4d46-91d0-1c2a2245a63e None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:27.947291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b13d2-50e4-4b47-a25c-99dd053ec8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:27.947998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b13d2-50e4-4b47-a25c-99dd053ec8dc None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.948283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b13d2-50e4-4b47-a25c-99dd053ec8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.948562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b13d2-50e4-4b47-a25c-99dd053ec8dc None admin] PATH_INFO: `/v3/groups` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.949256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b13d2-50e4-4b47-a25c-99dd053ec8dc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:27.950816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b13d2-50e4-4b47-a25c-99dd053ec8dc None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:27.965818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 168/324] 10.222.0.24 () {60 vars in 1134 bytes} [Wed May 25 15:00:27 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:00:27.973426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012e0cf-8a9e-40e7-b3fa-f70e985bfdf5 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.973715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012e0cf-8a9e-40e7-b3fa-f70e985bfdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.973994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012e0cf-8a9e-40e7-b3fa-f70e985bfdf5 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.975402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 169/325] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:00:27.981516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae42ad0-797f-4548-9189-d0332a9bbef1 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:27.981713 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae42ad0-797f-4548-9189-d0332a9bbef1 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:27.982093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae42ad0-797f-4548-9189-d0332a9bbef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:27.989710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:28.000776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-7ae42ad0-797f-4548-9189-d0332a9bbef1 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:28.001374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ffb25-4719-4222-8d66-5fddd205d048 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:28.001903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-7ae42ad0-797f-4548-9189-d0332a9bbef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:28.041543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bcc56-2835-496b-a33c-288303b2b4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:28.042368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bcc56-2835-496b-a33c-288303b2b4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.042863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bcc56-2835-496b-a33c-288303b2b4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.043145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bcc56-2835-496b-a33c-288303b2b4c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.055264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bcc56-2835-496b-a33c-288303b2b4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-553bcc56-2835-496b-a33c-288303b2b4c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:28.063358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:28.064600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:28.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:28.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:28.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:28.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:28.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:28.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:28.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:28.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:28.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:28.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:28.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:28.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:28.069925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 157/326] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:28.070941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bcc56-2835-496b-a33c-288303b2b4c0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:28.091731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 170/327] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:28.108045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae42ad0-797f-4548-9189-d0332a9bbef1 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:28.181353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bcc56-2835-496b-a33c-288303b2b4c0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:28.207953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:28.217648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44e9e4-9b0a-4443-93df-d48bbe49f761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:28.218265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e9e4-9b0a-4443-93df-d48bbe49f761 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.218547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e9e4-9b0a-4443-93df-d48bbe49f761 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.218830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e9e4-9b0a-4443-93df-d48bbe49f761 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.219880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e9e4-9b0a-4443-93df-d48bbe49f761 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:28.220232 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e9e4-9b0a-4443-93df-d48bbe49f761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:28.222008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e9e4-9b0a-4443-93df-d48bbe49f761 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:28.225058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae42ad0-797f-4548-9189-d0332a9bbef1 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:28.233786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 158/328] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:28.240447 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44e9e4-9b0a-4443-93df-d48bbe49f761 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:28.259814 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:28.267233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0745f1a-5fcb-4c36-848a-bd77ab509be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:28.268087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0745f1a-5fcb-4c36-848a-bd77ab509be6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.268368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0745f1a-5fcb-4c36-848a-bd77ab509be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.268641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0745f1a-5fcb-4c36-848a-bd77ab509be6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.281217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0745f1a-5fcb-4c36-848a-bd77ab509be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-f0745f1a-5fcb-4c36-848a-bd77ab509be6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:28.289075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:28.289980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:28.290776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:28.290776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:28.290776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:28.290776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:28.290776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:28.290776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:28.290776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:28.290776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:28.290776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:28.290776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:28.290776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:28.290776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:28.295178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 171/329] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:28.296651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0745f1a-5fcb-4c36-848a-bd77ab509be6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:28.362130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44e9e4-9b0a-4443-93df-d48bbe49f761 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:28.405859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a67cf3-3b9e-4ee5-8354-ac5746b174fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:28.407154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a67cf3-3b9e-4ee5-8354-ac5746b174fd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.407911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a67cf3-3b9e-4ee5-8354-ac5746b174fd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.409121 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a67cf3-3b9e-4ee5-8354-ac5746b174fd None admin] PATH_INFO: `/v3/users/80ab15aa4b2b4aa6b0a0b6b9cf84780b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.412649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a67cf3-3b9e-4ee5-8354-ac5746b174fd None admin] RBAC: Authorizing `identity:get_user(user_id=80ab15aa4b2b4aa6b0a0b6b9cf84780b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:28.414145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a67cf3-3b9e-4ee5-8354-ac5746b174fd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:28.416235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 159/330] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:28 2022] GET /identity/v3/users/80ab15aa4b2b4aa6b0a0b6b9cf84780b => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:28.421654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a67cf3-3b9e-4ee5-8354-ac5746b174fd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:28.427230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0745f1a-5fcb-4c36-848a-bd77ab509be6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:28.471889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22628-af71-45f7-85dd-c016a351f859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:28.473038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22628-af71-45f7-85dd-c016a351f859 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.473256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22628-af71-45f7-85dd-c016a351f859 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.473537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22628-af71-45f7-85dd-c016a351f859 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.474453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a22628-af71-45f7-85dd-c016a351f859 None admin] RBAC: Adding query filter params (name=member) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:28.474877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a22628-af71-45f7-85dd-c016a351f859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:28.476302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a22628-af71-45f7-85dd-c016a351f859 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:28.487378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 172/331] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:28.493009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22628-af71-45f7-85dd-c016a351f859 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:28.506689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:28.537220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:28.561309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a67cf3-3b9e-4ee5-8354-ac5746b174fd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:28.602374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22628-af71-45f7-85dd-c016a351f859 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:28.604422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8ba7-82be-422e-9f80-ce48f0435e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:28.605569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8ba7-82be-422e-9f80-ce48f0435e79 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.606073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8ba7-82be-422e-9f80-ce48f0435e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.606541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8ba7-82be-422e-9f80-ce48f0435e79 None admin] PATH_INFO: `/v3/system/users/80ab15aa4b2b4aa6b0a0b6b9cf84780b/roles/5cd390b79218462b9837d41be8ec8b5c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.608333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa8ba7-82be-422e-9f80-ce48f0435e79 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=80ab15aa4b2b4aa6b0a0b6b9cf84780b, role_id=5cd390b79218462b9837d41be8ec8b5c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:28.610028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa8ba7-82be-422e-9f80-ce48f0435e79 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:28.620649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 160/332] 10.222.0.24 () {58 vars in 1334 bytes} [Wed May 25 15:00:28 2022] PUT /identity/v3/system/users/80ab15aa4b2b4aa6b0a0b6b9cf84780b/roles/5cd390b79218462b9837d41be8ec8b5c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:28.640641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddeb510-20a7-4446-b3ed-0441d8ba2e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:28.641614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeb510-20a7-4446-b3ed-0441d8ba2e17 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.641902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeb510-20a7-4446-b3ed-0441d8ba2e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.642180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeb510-20a7-4446-b3ed-0441d8ba2e17 None admin] PATH_INFO: `/v3/users/4b0fb5c96753485793f93ab987aed130` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.643817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddeb510-20a7-4446-b3ed-0441d8ba2e17 None admin] RBAC: Authorizing `identity:get_user(user_id=4b0fb5c96753485793f93ab987aed130)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:28.645521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddeb510-20a7-4446-b3ed-0441d8ba2e17 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:28.651740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 173/333] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:28 2022] GET /identity/v3/users/4b0fb5c96753485793f93ab987aed130 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:28.654147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8ba7-82be-422e-9f80-ce48f0435e79 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:28.765285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8ba7-82be-422e-9f80-ce48f0435e79 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:28.811515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57517bf8-d0fc-453f-ae2f-c5d95203cf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:28.812232 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57517bf8-d0fc-453f-ae2f-c5d95203cf9e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:28.812537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57517bf8-d0fc-453f-ae2f-c5d95203cf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:28.813036 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57517bf8-d0fc-453f-ae2f-c5d95203cf9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:28.814738 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57517bf8-d0fc-453f-ae2f-c5d95203cf9e None admin] RBAC: Adding query filter params (role.id=88c41930377947b7a1dc0134ba0f787b, user.id=4b0fb5c96753485793f93ab987aed130, scope.system=all) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:28.815324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57517bf8-d0fc-453f-ae2f-c5d95203cf9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:28.817164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57517bf8-d0fc-453f-ae2f-c5d95203cf9e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:28.832202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 161/334] 10.222.0.24 () {56 vars in 1308 bytes} [Wed May 25 15:00:28 2022] GET /identity/v3/role_assignments?user.id=4b0fb5c96753485793f93ab987aed130&scope.system=all&role.id=88c41930377947b7a1dc0134ba0f787b => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:30.591760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eccd66-7500-42a1-8d94-ef047b544518 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:30.592375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eccd66-7500-42a1-8d94-ef047b544518 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:30.592375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eccd66-7500-42a1-8d94-ef047b544518 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:30.593825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 174/335] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:30.599269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631969d-17f2-4e5c-8680-14c3f8407c05 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:30.599711 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631969d-17f2-4e5c-8680-14c3f8407c05 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:30.599901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631969d-17f2-4e5c-8680-14c3f8407c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:30.605540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:30.624706 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f631969d-17f2-4e5c-8680-14c3f8407c05 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:30.625920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f631969d-17f2-4e5c-8680-14c3f8407c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:30.709342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 162/336] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:30.744678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eccd66-7500-42a1-8d94-ef047b544518 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:30.773116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fd264-d43e-40f9-b0ab-dd7eb46c160d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:30.773426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fd264-d43e-40f9-b0ab-dd7eb46c160d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:30.773676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fd264-d43e-40f9-b0ab-dd7eb46c160d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:30.775328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 163/337] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:00:30.783250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8873514-7363-4a9b-b285-bf50defab06c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:30.783580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8873514-7363-4a9b-b285-bf50defab06c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:30.783841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8873514-7363-4a9b-b285-bf50defab06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:30.816666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b8873514-7363-4a9b-b285-bf50defab06c None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:30.818299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b8873514-7363-4a9b-b285-bf50defab06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:30.907587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:30.953496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eccd66-7500-42a1-8d94-ef047b544518 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:30.973434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 164/338] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:31.020276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee46baa-8a99-48af-bf35-f1dae8fa33ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:31.021005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8873514-7363-4a9b-b285-bf50defab06c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:31.021112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46baa-8a99-48af-bf35-f1dae8fa33ce None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.021371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46baa-8a99-48af-bf35-f1dae8fa33ce None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.021653 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46baa-8a99-48af-bf35-f1dae8fa33ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.037795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee46baa-8a99-48af-bf35-f1dae8fa33ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-7ee46baa-8a99-48af-bf35-f1dae8fa33ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:31.046326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:31.047272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:31.048100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:31.048100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:31.048100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:31.048100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:31.048100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:31.048100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:31.048100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:31.048100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:31.048100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:31.048100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:31.048100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:31.048100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:31.052124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 175/339] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:31.054794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee46baa-8a99-48af-bf35-f1dae8fa33ce None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:31.157055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:31.233479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8873514-7363-4a9b-b285-bf50defab06c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:31.255432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee46baa-8a99-48af-bf35-f1dae8fa33ce None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:31.276704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529c930-8b14-4439-9ed9-1a17c94bb157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:31.277940 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529c930-8b14-4439-9ed9-1a17c94bb157 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.278414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529c930-8b14-4439-9ed9-1a17c94bb157 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.278877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529c930-8b14-4439-9ed9-1a17c94bb157 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.292319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529c930-8b14-4439-9ed9-1a17c94bb157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-5529c930-8b14-4439-9ed9-1a17c94bb157 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:31.301818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:31.302685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:31.303471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:31.303471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:31.303471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:31.303471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:31.303471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:31.303471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:31.303471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:31.303471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:31.303471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:31.303471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:31.303471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:31.303471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:31.306367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 165/340] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:00:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:31.308056 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f03998-e0b5-4563-9f2d-a570dc3bda2a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.308543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f03998-e0b5-4563-9f2d-a570dc3bda2a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.309006 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f03998-e0b5-4563-9f2d-a570dc3bda2a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.311526 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 166/341] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:31.312703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f03998-e0b5-4563-9f2d-a570dc3bda2a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:31.341003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564a3e4-2792-4a1d-8645-abe21a198dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:31.341792 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a3e4-2792-4a1d-8645-abe21a198dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.342087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a3e4-2792-4a1d-8645-abe21a198dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.342371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a3e4-2792-4a1d-8645-abe21a198dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.343170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564a3e4-2792-4a1d-8645-abe21a198dc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:31.343456 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564a3e4-2792-4a1d-8645-abe21a198dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:31.345187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564a3e4-2792-4a1d-8645-abe21a198dc4 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:31.356148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:31.359722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 176/342] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:31.361503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aeb4d-cbdd-45f5-bf22-76ccc1da9ab3 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.361503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aeb4d-cbdd-45f5-bf22-76ccc1da9ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.361767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aeb4d-cbdd-45f5-bf22-76ccc1da9ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.400620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-2e0aeb4d-cbdd-45f5-bf22-76ccc1da9ab3 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:31.402169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-2e0aeb4d-cbdd-45f5-bf22-76ccc1da9ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:31.430842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f03998-e0b5-4563-9f2d-a570dc3bda2a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:31.455974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:31.471955 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342626a9-8794-497f-a22f-5a61bad86f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:31.472639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342626a9-8794-497f-a22f-5a61bad86f21 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.473003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342626a9-8794-497f-a22f-5a61bad86f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.473286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342626a9-8794-497f-a22f-5a61bad86f21 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.474147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342626a9-8794-497f-a22f-5a61bad86f21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:31.474461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342626a9-8794-497f-a22f-5a61bad86f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:31.475906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342626a9-8794-497f-a22f-5a61bad86f21 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:31.486789 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 167/343] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:31.486789 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342626a9-8794-497f-a22f-5a61bad86f21 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:31.546776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 177/344] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:31.548297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aeb4d-cbdd-45f5-bf22-76ccc1da9ab3 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:31.597531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342626a9-8794-497f-a22f-5a61bad86f21 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:31.632861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5df404-d7f2-4ea9-91c6-15d0985d097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:31.633512 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5df404-d7f2-4ea9-91c6-15d0985d097d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.633794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5df404-d7f2-4ea9-91c6-15d0985d097d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.634070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5df404-d7f2-4ea9-91c6-15d0985d097d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.689082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:31.705088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5df404-d7f2-4ea9-91c6-15d0985d097d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:31.706834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5df404-d7f2-4ea9-91c6-15d0985d097d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:31.813464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 168/345] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:31.814681 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5df404-d7f2-4ea9-91c6-15d0985d097d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:31.819716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aeb4d-cbdd-45f5-bf22-76ccc1da9ab3 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:31.875920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:31.884965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d1e01-c8df-4cce-aec0-9d8f2d71a130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:31.886689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d1e01-c8df-4cce-aec0-9d8f2d71a130 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:31.887339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d1e01-c8df-4cce-aec0-9d8f2d71a130 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:31.888313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d1e01-c8df-4cce-aec0-9d8f2d71a130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:31.974005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:32.005120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5df404-d7f2-4ea9-91c6-15d0985d097d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.032443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d1e01-c8df-4cce-aec0-9d8f2d71a130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.034268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d1e01-c8df-4cce-aec0-9d8f2d71a130 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.073726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bda97-20e8-4972-b5f3-030534a5c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.074886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bda97-20e8-4972-b5f3-030534a5c2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.075381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bda97-20e8-4972-b5f3-030534a5c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.075992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bda97-20e8-4972-b5f3-030534a5c2f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.095400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bda97-20e8-4972-b5f3-030534a5c2f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c09bda97-20e8-4972-b5f3-030534a5c2f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:32.113669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:32.114708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:32.116150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:32.116150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:32.116150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:32.116150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:32.116150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:32.116150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:32.116150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:32.116150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:32.116150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:32.116150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:32.116150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:32.116150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:32.123870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 169/346] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:32.125243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bda97-20e8-4972-b5f3-030534a5c2f2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.216148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 178/347] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:32.216558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d1e01-c8df-4cce-aec0-9d8f2d71a130 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.248695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:32.256920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bda97-20e8-4972-b5f3-030534a5c2f2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.293977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3efbe-03f9-4939-bb71-6711f497cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.295349 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3efbe-03f9-4939-bb71-6711f497cba7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.295879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3efbe-03f9-4939-bb71-6711f497cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.296381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3efbe-03f9-4939-bb71-6711f497cba7 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.298477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3efbe-03f9-4939-bb71-6711f497cba7 None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.300242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3efbe-03f9-4939-bb71-6711f497cba7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.302763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 170/348] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:32 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:32.304325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857efc28-73ce-43c5-a204-09dbe618b49e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.304833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857efc28-73ce-43c5-a204-09dbe618b49e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.305313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857efc28-73ce-43c5-a204-09dbe618b49e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.307114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 171/349] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:32.308089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857efc28-73ce-43c5-a204-09dbe618b49e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.324853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:32.325132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d1e01-c8df-4cce-aec0-9d8f2d71a130 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.361536 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec14983-342c-490f-8f77-1baf6a5a75aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.362222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec14983-342c-490f-8f77-1baf6a5a75aa None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.362509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec14983-342c-490f-8f77-1baf6a5a75aa None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.362786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec14983-342c-490f-8f77-1baf6a5a75aa None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.363548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec14983-342c-490f-8f77-1baf6a5a75aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:32.363902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec14983-342c-490f-8f77-1baf6a5a75aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.365408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec14983-342c-490f-8f77-1baf6a5a75aa None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.374196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 179/350] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:32.375024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec14983-342c-490f-8f77-1baf6a5a75aa None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.428464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857efc28-73ce-43c5-a204-09dbe618b49e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.479769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:32.482472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b3dfb-b006-4701-9eb1-35d08db125ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.483708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b3dfb-b006-4701-9eb1-35d08db125ef None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.483968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b3dfb-b006-4701-9eb1-35d08db125ef None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.484356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b3dfb-b006-4701-9eb1-35d08db125ef None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.485925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b3dfb-b006-4701-9eb1-35d08db125ef None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.487434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b3dfb-b006-4701-9eb1-35d08db125ef None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.493624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 172/351] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:32 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:32.493624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341be5d-74ca-4915-bf8d-c7ff9cfb2fb8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.493624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341be5d-74ca-4915-bf8d-c7ff9cfb2fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.493624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341be5d-74ca-4915-bf8d-c7ff9cfb2fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.496081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec14983-342c-490f-8f77-1baf6a5a75aa None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.512123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0341be5d-74ca-4915-bf8d-c7ff9cfb2fb8 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:32.513337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0341be5d-74ca-4915-bf8d-c7ff9cfb2fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:32.539736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9c510-534f-4eb1-8ef4-107a8c4a4b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.541276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9c510-534f-4eb1-8ef4-107a8c4a4b2f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.542018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9c510-534f-4eb1-8ef4-107a8c4a4b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.542907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9c510-534f-4eb1-8ef4-107a8c4a4b2f None admin] PATH_INFO: `/v3/groups/d375f38d0a1f43b391592a1593e1e1ff` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.551926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9c510-534f-4eb1-8ef4-107a8c4a4b2f None admin] RBAC: Authorizing `identity:get_group(group_id=d375f38d0a1f43b391592a1593e1e1ff)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.553881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9c510-534f-4eb1-8ef4-107a8c4a4b2f None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.557315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 180/352] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:32 2022] GET /identity/v3/groups/d375f38d0a1f43b391592a1593e1e1ff => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:32.558475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9c510-534f-4eb1-8ef4-107a8c4a4b2f None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.592813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 173/353] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:32.593604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341be5d-74ca-4915-bf8d-c7ff9cfb2fb8 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.617487 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:32.682700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9c510-534f-4eb1-8ef4-107a8c4a4b2f None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.726745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cb265-2fbb-44b2-8e48-0554a64f14f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.727414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cb265-2fbb-44b2-8e48-0554a64f14f0 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.727739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cb265-2fbb-44b2-8e48-0554a64f14f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.728236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cb265-2fbb-44b2-8e48-0554a64f14f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.735298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341be5d-74ca-4915-bf8d-c7ff9cfb2fb8 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.759439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:32.780728 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b63519-ba36-48b6-b32f-0e9873df6f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.781709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b63519-ba36-48b6-b32f-0e9873df6f62 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.781997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b63519-ba36-48b6-b32f-0e9873df6f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.782275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b63519-ba36-48b6-b32f-0e9873df6f62 None admin] PATH_INFO: `/v3/groups/d375f38d0a1f43b391592a1593e1e1ff` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.785705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b63519-ba36-48b6-b32f-0e9873df6f62 None admin] RBAC: Authorizing `identity:get_group(group_id=d375f38d0a1f43b391592a1593e1e1ff)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.786058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b63519-ba36-48b6-b32f-0e9873df6f62 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.791684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 174/354] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:32 2022] GET /identity/v3/groups/d375f38d0a1f43b391592a1593e1e1ff => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:32.791684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b63519-ba36-48b6-b32f-0e9873df6f62 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.813199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cb265-2fbb-44b2-8e48-0554a64f14f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.815316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cb265-2fbb-44b2-8e48-0554a64f14f0 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.898890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:32.929448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b63519-ba36-48b6-b32f-0e9873df6f62 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:32.941357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 181/355] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:32.943987 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88f038-3329-4868-9581-1e2a4a4c9ebf None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.944477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88f038-3329-4868-9581-1e2a4a4c9ebf None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.945098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88f038-3329-4868-9581-1e2a4a4c9ebf None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.947238 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 182/356] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:32.948336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88f038-3329-4868-9581-1e2a4a4c9ebf None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:32.971272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea437d-1dca-4d84-bf86-9a26713c752e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:32.972405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea437d-1dca-4d84-bf86-9a26713c752e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:32.972922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea437d-1dca-4d84-bf86-9a26713c752e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:32.973293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea437d-1dca-4d84-bf86-9a26713c752e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:32.974178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea437d-1dca-4d84-bf86-9a26713c752e None admin] RBAC: Adding query filter params (group.id=d375f38d0a1f43b391592a1593e1e1ff, role.id=88c41930377947b7a1dc0134ba0f787b, scope.project.id=903a0b97a2f547ba915abf85091b8d33) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:32.974491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea437d-1dca-4d84-bf86-9a26713c752e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:32.976075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea437d-1dca-4d84-bf86-9a26713c752e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:32.982592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 175/357] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 15:00:32 2022] GET /identity/v3/role_assignments?group.id=d375f38d0a1f43b391592a1593e1e1ff&scope.project.id=903a0b97a2f547ba915abf85091b8d33&role.id=88c41930377947b7a1dc0134ba0f787b => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:32.983384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea437d-1dca-4d84-bf86-9a26713c752e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:33.044947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:33.105282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88f038-3329-4868-9581-1e2a4a4c9ebf None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:33.125375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea437d-1dca-4d84-bf86-9a26713c752e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:33.145619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3288dff-8587-4a9f-8dc3-535412aae391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:33.146538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3288dff-8587-4a9f-8dc3-535412aae391 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.146828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3288dff-8587-4a9f-8dc3-535412aae391 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.147153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3288dff-8587-4a9f-8dc3-535412aae391 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.164808 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3288dff-8587-4a9f-8dc3-535412aae391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:33.172990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d175de-3bd4-4c5e-99eb-df1a88d9c22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:33.173740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d175de-3bd4-4c5e-99eb-df1a88d9c22b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.174088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d175de-3bd4-4c5e-99eb-df1a88d9c22b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.174372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d175de-3bd4-4c5e-99eb-df1a88d9c22b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-b3288dff-8587-4a9f-8dc3-535412aae391 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:33.174600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:33.175444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:33.176288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:33.176288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:33.176288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:33.176288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:33.176288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:33.176288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:33.176288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:33.176288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:33.176288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:33.176288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:33.176288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:00:33.176288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:33.176907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d175de-3bd4-4c5e-99eb-df1a88d9c22b None admin] RBAC: Adding query filter params (group.id=d375f38d0a1f43b391592a1593e1e1ff, role.id=47a961686ccc4c6a8bb05e0f3fe5ffba, scope.project.id=903a0b97a2f547ba915abf85091b8d33) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:33.176907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d175de-3bd4-4c5e-99eb-df1a88d9c22b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:33.177036 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 183/358] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:33.177036 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3288dff-8587-4a9f-8dc3-535412aae391 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:33.177152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d175de-3bd4-4c5e-99eb-df1a88d9c22b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:33.192221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 176/359] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 15:00:32 2022] GET /identity/v3/role_assignments?group.id=d375f38d0a1f43b391592a1593e1e1ff&scope.project.id=903a0b97a2f547ba915abf85091b8d33&role.id=47a961686ccc4c6a8bb05e0f3fe5ffba => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:33.193706 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b016bff-e731-47cb-9c47-78b7d1a1600e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.194001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b016bff-e731-47cb-9c47-78b7d1a1600e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.194279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b016bff-e731-47cb-9c47-78b7d1a1600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.212670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:33.215882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3b016bff-e731-47cb-9c47-78b7d1a1600e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:33.217625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3b016bff-e731-47cb-9c47-78b7d1a1600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:33.310217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 177/360] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:33.311412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b016bff-e731-47cb-9c47-78b7d1a1600e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:33.338099 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3288dff-8587-4a9f-8dc3-535412aae391 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:33.366008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:33.392920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470086ce-8b94-4dc8-b690-146d4ce202ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:33.393831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470086ce-8b94-4dc8-b690-146d4ce202ba None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.394115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470086ce-8b94-4dc8-b690-146d4ce202ba None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.394392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470086ce-8b94-4dc8-b690-146d4ce202ba None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.396770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470086ce-8b94-4dc8-b690-146d4ce202ba None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:33.398261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470086ce-8b94-4dc8-b690-146d4ce202ba None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:33.401627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 184/361] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:33 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:33.403303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7509be-7a80-47fc-ab8f-f2ab92614c7f None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.404384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7509be-7a80-47fc-ab8f-f2ab92614c7f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.404384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7509be-7a80-47fc-ab8f-f2ab92614c7f None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.405198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 185/362] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:33.407506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7509be-7a80-47fc-ab8f-f2ab92614c7f None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:33.446820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b016bff-e731-47cb-9c47-78b7d1a1600e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:33.501768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ac571-617e-44a6-ae5a-24eb9b2f3427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:33.502494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ac571-617e-44a6-ae5a-24eb9b2f3427 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.502825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ac571-617e-44a6-ae5a-24eb9b2f3427 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.503113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ac571-617e-44a6-ae5a-24eb9b2f3427 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.504158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ac571-617e-44a6-ae5a-24eb9b2f3427 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:33.504866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ac571-617e-44a6-ae5a-24eb9b2f3427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:33.506551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ac571-617e-44a6-ae5a-24eb9b2f3427 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:33.510133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:33.520513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 178/363] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:33.521378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ac571-617e-44a6-ae5a-24eb9b2f3427 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:33.556567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7509be-7a80-47fc-ab8f-f2ab92614c7f None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:33.601564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37d99b-196a-4ff2-8261-9785c6501d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:33.603314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37d99b-196a-4ff2-8261-9785c6501d53 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.604521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37d99b-196a-4ff2-8261-9785c6501d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.605282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37d99b-196a-4ff2-8261-9785c6501d53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.618706 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37d99b-196a-4ff2-8261-9785c6501d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-8d37d99b-196a-4ff2-8261-9785c6501d53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:33.634571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:33.635535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:33.637022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 186/364] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:00:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:33.637696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7421a-99a0-4b68-9901-9776a599eaa2 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.637760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7421a-99a0-4b68-9901-9776a599eaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.638022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7421a-99a0-4b68-9901-9776a599eaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.654050 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ac571-617e-44a6-ae5a-24eb9b2f3427 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:33.656127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-04e7421a-99a0-4b68-9901-9776a599eaa2 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:33.658417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-04e7421a-99a0-4b68-9901-9776a599eaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:33.697458 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7709e-7ef3-427d-bf94-e58f47a68137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:33.698788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7709e-7ef3-427d-bf94-e58f47a68137 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.699313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7709e-7ef3-427d-bf94-e58f47a68137 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.699611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7709e-7ef3-427d-bf94-e58f47a68137 None admin] PATH_INFO: `/v3/groups/d375f38d0a1f43b391592a1593e1e1ff` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.701128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7709e-7ef3-427d-bf94-e58f47a68137 None admin] RBAC: Authorizing `identity:get_group(group_id=d375f38d0a1f43b391592a1593e1e1ff)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:33.702630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7709e-7ef3-427d-bf94-e58f47a68137 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:33.704573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 179/365] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:33 2022] GET /identity/v3/groups/d375f38d0a1f43b391592a1593e1e1ff => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:33.705379 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7709e-7ef3-427d-bf94-e58f47a68137 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:33.708427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:33.735960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 187/366] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:33.737005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7421a-99a0-4b68-9901-9776a599eaa2 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:33.782411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:33.821911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7709e-7ef3-427d-bf94-e58f47a68137 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:33.846499 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7421a-99a0-4b68-9901-9776a599eaa2 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:33.859473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cdfb5-3233-4d21-bc39-16de7842cf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:33.860406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cdfb5-3233-4d21-bc39-16de7842cf3d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.860784 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cdfb5-3233-4d21-bc39-16de7842cf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.861068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cdfb5-3233-4d21-bc39-16de7842cf3d None admin] PATH_INFO: `/v3/users/80ab15aa4b2b4aa6b0a0b6b9cf84780b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.862556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cdfb5-3233-4d21-bc39-16de7842cf3d None admin] RBAC: Authorizing `identity:get_user(user_id=80ab15aa4b2b4aa6b0a0b6b9cf84780b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:33.864162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cdfb5-3233-4d21-bc39-16de7842cf3d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:33.866530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 180/367] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:00:33 2022] GET /identity/v3/users/80ab15aa4b2b4aa6b0a0b6b9cf84780b => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:33.867488 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cdfb5-3233-4d21-bc39-16de7842cf3d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:33.883208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240323c4-e87b-42fe-8162-716dc795a201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:33.883925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240323c4-e87b-42fe-8162-716dc795a201 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:33.884211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240323c4-e87b-42fe-8162-716dc795a201 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:33.884492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240323c4-e87b-42fe-8162-716dc795a201 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:33.885371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240323c4-e87b-42fe-8162-716dc795a201 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:33.885782 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240323c4-e87b-42fe-8162-716dc795a201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:33.887202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240323c4-e87b-42fe-8162-716dc795a201 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:33.896410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 188/368] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:33.897246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240323c4-e87b-42fe-8162-716dc795a201 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:33.935009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:33.978745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cdfb5-3233-4d21-bc39-16de7842cf3d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.005063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240323c4-e87b-42fe-8162-716dc795a201 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.015866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7b743-95a7-4ec6-a1fa-a14629a2a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.016913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b743-95a7-4ec6-a1fa-a14629a2a3ae None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.017357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b743-95a7-4ec6-a1fa-a14629a2a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.017941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b743-95a7-4ec6-a1fa-a14629a2a3ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.019134 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7b743-95a7-4ec6-a1fa-a14629a2a3ae None admin] RBAC: Adding query filter params (group.id=d375f38d0a1f43b391592a1593e1e1ff, role.id=88c41930377947b7a1dc0134ba0f787b, scope.project.id=17512cd0708a4c7aa66913e0ed2c1768) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:34.019624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7b743-95a7-4ec6-a1fa-a14629a2a3ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.021362 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7b743-95a7-4ec6-a1fa-a14629a2a3ae None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.023953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:34.029336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 181/369] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 15:00:33 2022] GET /identity/v3/role_assignments?group.id=d375f38d0a1f43b391592a1593e1e1ff&scope.project.id=17512cd0708a4c7aa66913e0ed2c1768&role.id=88c41930377947b7a1dc0134ba0f787b => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:34.030412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7b743-95a7-4ec6-a1fa-a14629a2a3ae None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:34.043710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff76ac3-3d32-430e-b91c-b70899339bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.044831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff76ac3-3d32-430e-b91c-b70899339bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.044969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff76ac3-3d32-430e-b91c-b70899339bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.045189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff76ac3-3d32-430e-b91c-b70899339bf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.057649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff76ac3-3d32-430e-b91c-b70899339bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-6ff76ac3-3d32-430e-b91c-b70899339bf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:34.066515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:34.067718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:34.068850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 189/370] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:00:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:34.069528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff76ac3-3d32-430e-b91c-b70899339bf1 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:34.156023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7b743-95a7-4ec6-a1fa-a14629a2a3ae None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.179024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:34.186266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff76ac3-3d32-430e-b91c-b70899339bf1 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.196765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c09f1-d09d-4805-bec9-86ddd9870f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.197784 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c09f1-d09d-4805-bec9-86ddd9870f6f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.198209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c09f1-d09d-4805-bec9-86ddd9870f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.198649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c09f1-d09d-4805-bec9-86ddd9870f6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.199695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c09f1-d09d-4805-bec9-86ddd9870f6f None admin] RBAC: Adding query filter params (role.id=5cd390b79218462b9837d41be8ec8b5c, user.id=80ab15aa4b2b4aa6b0a0b6b9cf84780b, scope.system=all) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:34.200307 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c09f1-d09d-4805-bec9-86ddd9870f6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.202229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c09f1-d09d-4805-bec9-86ddd9870f6f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.216589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 182/371] 10.222.0.24 () {56 vars in 1308 bytes} [Wed May 25 15:00:34 2022] GET /identity/v3/role_assignments?user.id=80ab15aa4b2b4aa6b0a0b6b9cf84780b&scope.system=all&role.id=5cd390b79218462b9837d41be8ec8b5c => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:34.217967 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c09f1-d09d-4805-bec9-86ddd9870f6f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:34.223547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6643e-e563-4dd4-a0bc-22f135593987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.224278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6643e-e563-4dd4-a0bc-22f135593987 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.224586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6643e-e563-4dd4-a0bc-22f135593987 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.224851 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6643e-e563-4dd4-a0bc-22f135593987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.284936 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:34.309894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6643e-e563-4dd4-a0bc-22f135593987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.311744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6643e-e563-4dd4-a0bc-22f135593987 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.334366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c09f1-d09d-4805-bec9-86ddd9870f6f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.382845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098e086-1d40-4004-b0b2-0c2e56226d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.383635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e086-1d40-4004-b0b2-0c2e56226d55 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.383992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e086-1d40-4004-b0b2-0c2e56226d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.384378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e086-1d40-4004-b0b2-0c2e56226d55 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.385267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098e086-1d40-4004-b0b2-0c2e56226d55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:34.385645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098e086-1d40-4004-b0b2-0c2e56226d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.387242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098e086-1d40-4004-b0b2-0c2e56226d55 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.402861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 183/372] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:34.407601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098e086-1d40-4004-b0b2-0c2e56226d55 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:34.421228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:34.428793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 190/373] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:34.437352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6643e-e563-4dd4-a0bc-22f135593987 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:34.572861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6643e-e563-4dd4-a0bc-22f135593987 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.575793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098e086-1d40-4004-b0b2-0c2e56226d55 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.594306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:34.627268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323f37d-50e8-46c5-bbaa-d04ec496f4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.628435 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323f37d-50e8-46c5-bbaa-d04ec496f4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.628934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323f37d-50e8-46c5-bbaa-d04ec496f4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.629418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323f37d-50e8-46c5-bbaa-d04ec496f4d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.643214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa73ba8-6160-4032-a1d1-a8ef20feb45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.645359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa73ba8-6160-4032-a1d1-a8ef20feb45d None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.645359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa73ba8-6160-4032-a1d1-a8ef20feb45d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.645359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa73ba8-6160-4032-a1d1-a8ef20feb45d None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.648384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa73ba8-6160-4032-a1d1-a8ef20feb45d None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.649936 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa73ba8-6160-4032-a1d1-a8ef20feb45d None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.652085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 191/374] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:34 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:34.657130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa73ba8-6160-4032-a1d1-a8ef20feb45d None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:34.705962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323f37d-50e8-46c5-bbaa-d04ec496f4d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.707800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323f37d-50e8-46c5-bbaa-d04ec496f4d1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.765953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:34.814727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 184/375] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 15:00:34.820101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323f37d-50e8-46c5-bbaa-d04ec496f4d1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:34.840326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:34.859348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa73ba8-6160-4032-a1d1-a8ef20feb45d None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.928966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323f37d-50e8-46c5-bbaa-d04ec496f4d1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:34.942259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefac3b-f3e9-4850-b825-99f09cb3503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.943192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefac3b-f3e9-4850-b825-99f09cb3503d None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.943475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefac3b-f3e9-4850-b825-99f09cb3503d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.943778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefac3b-f3e9-4850-b825-99f09cb3503d None admin] PATH_INFO: `/v3/groups/d375f38d0a1f43b391592a1593e1e1ff` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.945147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefac3b-f3e9-4850-b825-99f09cb3503d None admin] RBAC: Authorizing `identity:get_group(group_id=d375f38d0a1f43b391592a1593e1e1ff)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.946595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefac3b-f3e9-4850-b825-99f09cb3503d None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.948592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 192/376] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:34 2022] GET /identity/v3/groups/d375f38d0a1f43b391592a1593e1e1ff => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:34.953844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefac3b-f3e9-4850-b825-99f09cb3503d None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:34.972540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df65bf6-32af-4fc5-9028-84f43012d778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:34.973982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65bf6-32af-4fc5-9028-84f43012d778 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:34.974472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65bf6-32af-4fc5-9028-84f43012d778 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:34.974939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65bf6-32af-4fc5-9028-84f43012d778 None admin] PATH_INFO: `/v3/projects/94e02961c51b473ebdfc8f91d292091e` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:34.981020 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df65bf6-32af-4fc5-9028-84f43012d778 None admin] RBAC: Authorizing `identity:get_project(project_id=94e02961c51b473ebdfc8f91d292091e)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:34.982924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df65bf6-32af-4fc5-9028-84f43012d778 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:34.986297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 185/377] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:34 2022] GET /identity/v3/projects/94e02961c51b473ebdfc8f91d292091e => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:34.992156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df65bf6-32af-4fc5-9028-84f43012d778 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:35.113678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefac3b-f3e9-4850-b825-99f09cb3503d None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:35.144270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df65bf6-32af-4fc5-9028-84f43012d778 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:35.147893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:35.165912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:35.178321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15634c30-c4bd-4a77-9913-16835aad5100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:35.179119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15634c30-c4bd-4a77-9913-16835aad5100 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:35.179405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15634c30-c4bd-4a77-9913-16835aad5100 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:35.179721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15634c30-c4bd-4a77-9913-16835aad5100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:35.180803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15634c30-c4bd-4a77-9913-16835aad5100 None admin] RBAC: Adding query filter params (group.id=d375f38d0a1f43b391592a1593e1e1ff, role.id=47a961686ccc4c6a8bb05e0f3fe5ffba, scope.project.id=17512cd0708a4c7aa66913e0ed2c1768) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:35.181199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15634c30-c4bd-4a77-9913-16835aad5100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:35.182651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15634c30-c4bd-4a77-9913-16835aad5100 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:35.193234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 193/378] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 15:00:34 2022] GET /identity/v3/role_assignments?group.id=d375f38d0a1f43b391592a1593e1e1ff&scope.project.id=17512cd0708a4c7aa66913e0ed2c1768&role.id=47a961686ccc4c6a8bb05e0f3fe5ffba => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:35.223483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b684f6b-cd4a-4414-997b-5d1cc692026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:35.224409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b684f6b-cd4a-4414-997b-5d1cc692026c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:35.224697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b684f6b-cd4a-4414-997b-5d1cc692026c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:35.224976 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b684f6b-cd4a-4414-997b-5d1cc692026c None admin] PATH_INFO: `/v3/groups/aa3df68ee79f4743bff5aed1aa353bd0` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:35.233913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b684f6b-cd4a-4414-997b-5d1cc692026c None admin] RBAC: Authorizing `identity:get_group(group_id=aa3df68ee79f4743bff5aed1aa353bd0)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:35.235402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b684f6b-cd4a-4414-997b-5d1cc692026c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:35.237762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 186/379] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:34 2022] GET /identity/v3/groups/aa3df68ee79f4743bff5aed1aa353bd0 => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:35.243552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15634c30-c4bd-4a77-9913-16835aad5100 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:35.390869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15634c30-c4bd-4a77-9913-16835aad5100 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:35.434581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be71754-9f8d-4ac9-ae6f-8dbd1704565c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:35.435635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be71754-9f8d-4ac9-ae6f-8dbd1704565c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:35.436123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be71754-9f8d-4ac9-ae6f-8dbd1704565c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:35.436597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be71754-9f8d-4ac9-ae6f-8dbd1704565c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:35.437644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be71754-9f8d-4ac9-ae6f-8dbd1704565c None admin] RBAC: Adding query filter params (group.id=aa3df68ee79f4743bff5aed1aa353bd0, role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=94e02961c51b473ebdfc8f91d292091e) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:35.438217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be71754-9f8d-4ac9-ae6f-8dbd1704565c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:35.439891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be71754-9f8d-4ac9-ae6f-8dbd1704565c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:35.446307 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 194/380] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 15:00:35 2022] GET /identity/v3/role_assignments?group.id=aa3df68ee79f4743bff5aed1aa353bd0&scope.project.id=94e02961c51b473ebdfc8f91d292091e&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:36.263602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38233-10bf-41a0-9334-9f9bc77aaf71 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:36.264158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38233-10bf-41a0-9334-9f9bc77aaf71 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:36.264158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38233-10bf-41a0-9334-9f9bc77aaf71 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:36.265707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 187/381] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:36.278189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de63a6-caab-48cc-a0b0-63cca02ebe3e None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:36.278640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de63a6-caab-48cc-a0b0-63cca02ebe3e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:36.278737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de63a6-caab-48cc-a0b0-63cca02ebe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:36.305920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-46de63a6-caab-48cc-a0b0-63cca02ebe3e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:36.307133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-46de63a6-caab-48cc-a0b0-63cca02ebe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:36.382028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:36.394253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 195/382] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:36.428593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38233-10bf-41a0-9334-9f9bc77aaf71 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:36.557287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38233-10bf-41a0-9334-9f9bc77aaf71 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:36.587162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb345be4-0010-4803-907f-c472bf2fe79f None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:36.587486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb345be4-0010-4803-907f-c472bf2fe79f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:36.587747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb345be4-0010-4803-907f-c472bf2fe79f None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:36.589556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 196/383] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:36.598300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beb6ca-860c-404f-8da3-198816c4cac3 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:36.598471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beb6ca-860c-404f-8da3-198816c4cac3 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:36.598663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beb6ca-860c-404f-8da3-198816c4cac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:36.603210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ed57b-5479-4478-93c1-36d3bda26545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:36.604483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ed57b-5479-4478-93c1-36d3bda26545 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:36.604998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ed57b-5479-4478-93c1-36d3bda26545 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:36.605485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ed57b-5479-4478-93c1-36d3bda26545 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:36.618115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ed57b-5479-4478-93c1-36d3bda26545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7f9ed57b-5479-4478-93c1-36d3bda26545 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:36.626543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:36.627427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:36.628546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:36.628546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:36.628546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:36.628546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:36.628546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:36.628546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:36.628546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:36.628546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:36.628546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:36.628546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:36.628546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:36.628546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:36.631087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 188/384] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:36.635592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-76beb6ca-860c-404f-8da3-198816c4cac3 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:36.635592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-76beb6ca-860c-404f-8da3-198816c4cac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:36.637539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ed57b-5479-4478-93c1-36d3bda26545 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:36.650991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:36.741512 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 197/385] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:36.742407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ed57b-5479-4478-93c1-36d3bda26545 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:36.791055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d979e2-acef-494f-97c6-26eb8c9fc02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:36.792125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d979e2-acef-494f-97c6-26eb8c9fc02f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:36.792633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d979e2-acef-494f-97c6-26eb8c9fc02f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:36.793131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d979e2-acef-494f-97c6-26eb8c9fc02f None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:36.794102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d979e2-acef-494f-97c6-26eb8c9fc02f None admin] RBAC: Adding query filter params (name=member) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:36.794614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d979e2-acef-494f-97c6-26eb8c9fc02f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:36.796300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d979e2-acef-494f-97c6-26eb8c9fc02f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:36.810611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 189/386] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:36.811978 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beb6ca-860c-404f-8da3-198816c4cac3 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:36.821207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d979e2-acef-494f-97c6-26eb8c9fc02f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:36.895937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:36.929153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d979e2-acef-494f-97c6-26eb8c9fc02f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:36.966282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd56fa-c05b-4cf9-935f-5e6a0282ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:36.967511 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd56fa-c05b-4cf9-935f-5e6a0282ee1a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:36.968322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd56fa-c05b-4cf9-935f-5e6a0282ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:36.968809 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd56fa-c05b-4cf9-935f-5e6a0282ee1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:36.981039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd56fa-c05b-4cf9-935f-5e6a0282ee1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-1ecd56fa-c05b-4cf9-935f-5e6a0282ee1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:36.990498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:36.991498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:36.992361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:36.992361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:36.992361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:36.992361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:36.992361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:36.992361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:36.992361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:36.992361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:36.992361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:36.992361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:36.992361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:36.992361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:36.995089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 190/387] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:00:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:37.001683 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd56fa-c05b-4cf9-935f-5e6a0282ee1a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.034113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beb6ca-860c-404f-8da3-198816c4cac3 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.061965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:37.078272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef807046-fb4d-4865-84f8-ae2527806707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.079500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef807046-fb4d-4865-84f8-ae2527806707 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.080015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef807046-fb4d-4865-84f8-ae2527806707 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.080500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef807046-fb4d-4865-84f8-ae2527806707 None admin] PATH_INFO: `/v3/groups/d375f38d0a1f43b391592a1593e1e1ff` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.081888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef807046-fb4d-4865-84f8-ae2527806707 None admin] RBAC: Authorizing `identity:get_group(group_id=d375f38d0a1f43b391592a1593e1e1ff)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.084205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef807046-fb4d-4865-84f8-ae2527806707 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.086386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 198/388] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:36 2022] GET /identity/v3/groups/d375f38d0a1f43b391592a1593e1e1ff => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:37.087819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2de65-f6a5-4c06-a30d-bb83854a432f None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.088340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2de65-f6a5-4c06-a30d-bb83854a432f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.093152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2de65-f6a5-4c06-a30d-bb83854a432f None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.095189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 199/389] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:37.096218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2de65-f6a5-4c06-a30d-bb83854a432f None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.123525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd56fa-c05b-4cf9-935f-5e6a0282ee1a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.158873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0fc88-b08a-4b03-86f2-1efd58cd3b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.159576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0fc88-b08a-4b03-86f2-1efd58cd3b66 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.159938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0fc88-b08a-4b03-86f2-1efd58cd3b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.160146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0fc88-b08a-4b03-86f2-1efd58cd3b66 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.160954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0fc88-b08a-4b03-86f2-1efd58cd3b66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:37.161265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0fc88-b08a-4b03-86f2-1efd58cd3b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.163539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0fc88-b08a-4b03-86f2-1efd58cd3b66 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.168748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:37.172220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 191/390] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:37.173759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d426ad-f121-4452-a8e3-92938421aed6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.174049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d426ad-f121-4452-a8e3-92938421aed6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.179590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d426ad-f121-4452-a8e3-92938421aed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.192767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f8d426ad-f121-4452-a8e3-92938421aed6 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:37.193952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f8d426ad-f121-4452-a8e3-92938421aed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:37.215201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2de65-f6a5-4c06-a30d-bb83854a432f None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.251715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b39960-0f16-4c90-a086-8296c09784c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.252939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b39960-0f16-4c90-a086-8296c09784c9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.253423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b39960-0f16-4c90-a086-8296c09784c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.253896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b39960-0f16-4c90-a086-8296c09784c9 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.255358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b39960-0f16-4c90-a086-8296c09784c9 None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.257076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b39960-0f16-4c90-a086-8296c09784c9 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.259003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 200/391] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:37 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:37.260916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b39960-0f16-4c90-a086-8296c09784c9 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.265897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 192/392] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:37.266731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d426ad-f121-4452-a8e3-92938421aed6 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.320278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:37.366831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b39960-0f16-4c90-a086-8296c09784c9 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.395750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d426ad-f121-4452-a8e3-92938421aed6 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.403412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68453f44-f3da-4092-9079-dbb099498213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.404602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68453f44-f3da-4092-9079-dbb099498213 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.405113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68453f44-f3da-4092-9079-dbb099498213 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.405587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68453f44-f3da-4092-9079-dbb099498213 None admin] PATH_INFO: `/v3/groups/d375f38d0a1f43b391592a1593e1e1ff` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.407033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68453f44-f3da-4092-9079-dbb099498213 None admin] RBAC: Authorizing `identity:get_group(group_id=d375f38d0a1f43b391592a1593e1e1ff)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.408716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68453f44-f3da-4092-9079-dbb099498213 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.415314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 201/393] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:37 2022] GET /identity/v3/groups/d375f38d0a1f43b391592a1593e1e1ff => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:37.416464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68453f44-f3da-4092-9079-dbb099498213 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.432953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5a14a-72f4-41c6-b5ea-4a9b36496125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.433911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5a14a-72f4-41c6-b5ea-4a9b36496125 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.434483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5a14a-72f4-41c6-b5ea-4a9b36496125 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.434483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5a14a-72f4-41c6-b5ea-4a9b36496125 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33/groups/d375f38d0a1f43b391592a1593e1e1ff/roles/88c41930377947b7a1dc0134ba0f787b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.436588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5a14a-72f4-41c6-b5ea-4a9b36496125 None admin] RBAC: Authorizing `identity:create_grant(project_id=903a0b97a2f547ba915abf85091b8d33, group_id=d375f38d0a1f43b391592a1593e1e1ff, role_id=88c41930377947b7a1dc0134ba0f787b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.438138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5a14a-72f4-41c6-b5ea-4a9b36496125 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.444086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:37.463632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 193/394] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 15:00:37 2022] PUT /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33/groups/d375f38d0a1f43b391592a1593e1e1ff/roles/88c41930377947b7a1dc0134ba0f787b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:37.464144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5a14a-72f4-41c6-b5ea-4a9b36496125 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.544070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68453f44-f3da-4092-9079-dbb099498213 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.570851 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:37.585391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65a764-db1d-4bf1-92a4-f4c6ad1be9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.586276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a764-db1d-4bf1-92a4-f4c6ad1be9bc None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.586619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a764-db1d-4bf1-92a4-f4c6ad1be9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.586905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a764-db1d-4bf1-92a4-f4c6ad1be9bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.601029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65a764-db1d-4bf1-92a4-f4c6ad1be9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:37.606682 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5a14a-72f4-41c6-b5ea-4a9b36496125 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-ee65a764-db1d-4bf1-92a4-f4c6ad1be9bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:37.609216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:37.610154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:37.610966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 202/395] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:37.616931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65a764-db1d-4bf1-92a4-f4c6ad1be9bc None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.651891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3fe2f-f4a2-42a7-afb4-dc842c186888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.652919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3fe2f-f4a2-42a7-afb4-dc842c186888 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.653204 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3fe2f-f4a2-42a7-afb4-dc842c186888 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.653732 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3fe2f-f4a2-42a7-afb4-dc842c186888 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.655624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3fe2f-f4a2-42a7-afb4-dc842c186888 None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.657080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3fe2f-f4a2-42a7-afb4-dc842c186888 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.660283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 194/396] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:37 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:37.667399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3fe2f-f4a2-42a7-afb4-dc842c186888 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.738017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:37.750915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65a764-db1d-4bf1-92a4-f4c6ad1be9bc None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.794837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3fe2f-f4a2-42a7-afb4-dc842c186888 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:37.796907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30accb6c-5e48-43e4-bc70-3a9aa6331c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.798465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30accb6c-5e48-43e4-bc70-3a9aa6331c73 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.798761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30accb6c-5e48-43e4-bc70-3a9aa6331c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.799046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30accb6c-5e48-43e4-bc70-3a9aa6331c73 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.799867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30accb6c-5e48-43e4-bc70-3a9aa6331c73 None admin] RBAC: Adding query filter params (name=member) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:37.800183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30accb6c-5e48-43e4-bc70-3a9aa6331c73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.801624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30accb6c-5e48-43e4-bc70-3a9aa6331c73 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.814445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 203/397] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:37.828417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30accb6c-5e48-43e4-bc70-3a9aa6331c73 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:37.853759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c73ee-4d15-4cea-adb7-afaff6b98555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:37.854758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c73ee-4d15-4cea-adb7-afaff6b98555 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:37.855050 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c73ee-4d15-4cea-adb7-afaff6b98555 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:37.855324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c73ee-4d15-4cea-adb7-afaff6b98555 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33/groups/d375f38d0a1f43b391592a1593e1e1ff/roles/47a961686ccc4c6a8bb05e0f3fe5ffba` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:37.863025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c73ee-4d15-4cea-adb7-afaff6b98555 None admin] RBAC: Authorizing `identity:create_grant(project_id=903a0b97a2f547ba915abf85091b8d33, group_id=d375f38d0a1f43b391592a1593e1e1ff, role_id=47a961686ccc4c6a8bb05e0f3fe5ffba)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:37.864997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c73ee-4d15-4cea-adb7-afaff6b98555 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:37.883210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 195/398] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 15:00:37 2022] PUT /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33/groups/d375f38d0a1f43b391592a1593e1e1ff/roles/47a961686ccc4c6a8bb05e0f3fe5ffba => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:37.885464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:37.953788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30accb6c-5e48-43e4-bc70-3a9aa6331c73 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.001815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8443d9-5575-44dc-bbc2-abe6ceff2dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.002708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8443d9-5575-44dc-bbc2-abe6ceff2dec None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.002994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8443d9-5575-44dc-bbc2-abe6ceff2dec None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.003280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8443d9-5575-44dc-bbc2-abe6ceff2dec None admin] PATH_INFO: `/v3/groups/d375f38d0a1f43b391592a1593e1e1ff` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.004586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8443d9-5575-44dc-bbc2-abe6ceff2dec None admin] RBAC: Authorizing `identity:get_group(group_id=d375f38d0a1f43b391592a1593e1e1ff)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.006249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8443d9-5575-44dc-bbc2-abe6ceff2dec None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:38.008368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 204/399] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:37 2022] GET /identity/v3/groups/d375f38d0a1f43b391592a1593e1e1ff => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:38.014384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c73ee-4d15-4cea-adb7-afaff6b98555 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.044261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cbcf8-69ee-4870-886b-b9d3474220c9 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.044595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cbcf8-69ee-4870-886b-b9d3474220c9 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.044810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cbcf8-69ee-4870-886b-b9d3474220c9 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.046444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 205/400] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:38.052235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb2ef1-650c-420a-8e45-ad9e2aaeb139 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.052544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb2ef1-650c-420a-8e45-ad9e2aaeb139 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.052794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb2ef1-650c-420a-8e45-ad9e2aaeb139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.076488 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-45fb2ef1-650c-420a-8e45-ad9e2aaeb139 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:38.077886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-45fb2ef1-650c-420a-8e45-ad9e2aaeb139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:38.158885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c73ee-4d15-4cea-adb7-afaff6b98555 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.173914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:38.197145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 206/401] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:38.198775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a8ef4-3fa9-41a5-92d5-64dd731810ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.200495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a8ef4-3fa9-41a5-92d5-64dd731810ae None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.200495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a8ef4-3fa9-41a5-92d5-64dd731810ae None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.200495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a8ef4-3fa9-41a5-92d5-64dd731810ae None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.201573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a8ef4-3fa9-41a5-92d5-64dd731810ae None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.203028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a8ef4-3fa9-41a5-92d5-64dd731810ae None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:38.207599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 196/402] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:38 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:38.210761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb2ef1-650c-420a-8e45-ad9e2aaeb139 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.222957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a8ef4-3fa9-41a5-92d5-64dd731810ae None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.286176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:38.356584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a8ef4-3fa9-41a5-92d5-64dd731810ae None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.359094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb2ef1-650c-420a-8e45-ad9e2aaeb139 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.407588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c3836-f81a-4b3b-92dc-142b47307c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.407588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c3836-f81a-4b3b-92dc-142b47307c56 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.407588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c3836-f81a-4b3b-92dc-142b47307c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.407588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c3836-f81a-4b3b-92dc-142b47307c56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.415212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290aabd-cbf9-43d7-aa0a-f036330687e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.416348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290aabd-cbf9-43d7-aa0a-f036330687e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.416770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290aabd-cbf9-43d7-aa0a-f036330687e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.417231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290aabd-cbf9-43d7-aa0a-f036330687e1 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768/groups/d375f38d0a1f43b391592a1593e1e1ff/roles/88c41930377947b7a1dc0134ba0f787b` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.419806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290aabd-cbf9-43d7-aa0a-f036330687e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=17512cd0708a4c7aa66913e0ed2c1768, group_id=d375f38d0a1f43b391592a1593e1e1ff, role_id=88c41930377947b7a1dc0134ba0f787b)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.422276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290aabd-cbf9-43d7-aa0a-f036330687e1 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:38.428268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c3836-f81a-4b3b-92dc-142b47307c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ed0c3836-f81a-4b3b-92dc-142b47307c56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:38.437558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:38.439189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:38.440592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:38.440592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:38.440592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:38.440592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:38.440592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:38.440592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:38.440592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:38.440592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:38.440592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:38.440592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:38.440592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:38.440592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:38.447090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 197/403] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:00:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:38.458623 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c3836-f81a-4b3b-92dc-142b47307c56 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.462266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 207/404] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 15:00:38 2022] PUT /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768/groups/d375f38d0a1f43b391592a1593e1e1ff/roles/88c41930377947b7a1dc0134ba0f787b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:00:38.487313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc31a1d-c5af-4682-9799-bc1bd817d175 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.488035 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc31a1d-c5af-4682-9799-bc1bd817d175 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.488323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc31a1d-c5af-4682-9799-bc1bd817d175 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.490066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 208/405] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:00:38.496278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97cfd2-2e06-42a5-961d-fcfcf5631aa6 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.496863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97cfd2-2e06-42a5-961d-fcfcf5631aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.497327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97cfd2-2e06-42a5-961d-fcfcf5631aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.527595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:38.532387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-ef97cfd2-2e06-42a5-961d-fcfcf5631aa6 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:38.533886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-ef97cfd2-2e06-42a5-961d-fcfcf5631aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:38.592162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c3836-f81a-4b3b-92dc-142b47307c56 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.630446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed3b65-dde4-415a-9b07-c68e68977caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.631147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed3b65-dde4-415a-9b07-c68e68977caa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.631428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed3b65-dde4-415a-9b07-c68e68977caa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.631739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed3b65-dde4-415a-9b07-c68e68977caa None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.632520 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed3b65-dde4-415a-9b07-c68e68977caa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:38.632833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed3b65-dde4-415a-9b07-c68e68977caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.634388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed3b65-dde4-415a-9b07-c68e68977caa None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:38.649432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 198/406] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:38.650823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed3b65-dde4-415a-9b07-c68e68977caa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.707673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 209/407] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:38.739876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97cfd2-2e06-42a5-961d-fcfcf5631aa6 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.770170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed3b65-dde4-415a-9b07-c68e68977caa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.771882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:38.783119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:38.810400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6965e-0f53-4475-823c-defd6c5cb29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.811285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6965e-0f53-4475-823c-defd6c5cb29f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.811605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6965e-0f53-4475-823c-defd6c5cb29f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.811874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6965e-0f53-4475-823c-defd6c5cb29f None admin] PATH_INFO: `/v3/groups/d375f38d0a1f43b391592a1593e1e1ff` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.813067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6965e-0f53-4475-823c-defd6c5cb29f None admin] RBAC: Authorizing `identity:get_group(group_id=d375f38d0a1f43b391592a1593e1e1ff)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:38.814803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6965e-0f53-4475-823c-defd6c5cb29f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:38.821123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 199/408] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:38 2022] GET /identity/v3/groups/d375f38d0a1f43b391592a1593e1e1ff => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:38.822283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6965e-0f53-4475-823c-defd6c5cb29f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:38.869530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97cfd2-2e06-42a5-961d-fcfcf5631aa6 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:38.908889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b055c-23be-44cb-abb4-ee98c3f70397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:38.910537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b055c-23be-44cb-abb4-ee98c3f70397 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:38.911019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b055c-23be-44cb-abb4-ee98c3f70397 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:38.911487 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b055c-23be-44cb-abb4-ee98c3f70397 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:38.924027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b055c-23be-44cb-abb4-ee98c3f70397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-b03b055c-23be-44cb-abb4-ee98c3f70397 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:38.933519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:38.934410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:38.935211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:38.935211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:38.935211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:38.935211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:38.935211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:38.935211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:38.935211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:38.935211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:38.935211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:38.935211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:38.935211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:38.935211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:38.937501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 210/409] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:38.943391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b055c-23be-44cb-abb4-ee98c3f70397 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.048226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6965e-0f53-4475-823c-defd6c5cb29f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:39.095101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:39.110968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b055c-23be-44cb-abb4-ee98c3f70397 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:39.131376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b595-733a-44a5-bc3a-c80c82e30e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:39.132283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b595-733a-44a5-bc3a-c80c82e30e44 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.132564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b595-733a-44a5-bc3a-c80c82e30e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.132837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b595-733a-44a5-bc3a-c80c82e30e44 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.134777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b595-733a-44a5-bc3a-c80c82e30e44 None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:39.136571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b595-733a-44a5-bc3a-c80c82e30e44 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.139173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 200/410] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:38 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:39.144025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b595-733a-44a5-bc3a-c80c82e30e44 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.164663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30e8aa-c664-4d2a-9c5e-c612dba613ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:39.168571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30e8aa-c664-4d2a-9c5e-c612dba613ee None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.169717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30e8aa-c664-4d2a-9c5e-c612dba613ee None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.169717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30e8aa-c664-4d2a-9c5e-c612dba613ee None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.170759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30e8aa-c664-4d2a-9c5e-c612dba613ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:39.171078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30e8aa-c664-4d2a-9c5e-c612dba613ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:39.172544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30e8aa-c664-4d2a-9c5e-c612dba613ee None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.198652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 211/411] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:39.203088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30e8aa-c664-4d2a-9c5e-c612dba613ee None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.223007 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:39.296655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b595-733a-44a5-bc3a-c80c82e30e44 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:39.357325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0c41c-ec39-43ff-9449-e0056bb705c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:39.358154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0c41c-ec39-43ff-9449-e0056bb705c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.358440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0c41c-ec39-43ff-9449-e0056bb705c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.358720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0c41c-ec39-43ff-9449-e0056bb705c2 None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768/groups/d375f38d0a1f43b391592a1593e1e1ff/roles/47a961686ccc4c6a8bb05e0f3fe5ffba` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.365089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0c41c-ec39-43ff-9449-e0056bb705c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=17512cd0708a4c7aa66913e0ed2c1768, group_id=d375f38d0a1f43b391592a1593e1e1ff, role_id=47a961686ccc4c6a8bb05e0f3fe5ffba)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:39.366651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0c41c-ec39-43ff-9449-e0056bb705c2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.381550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30e8aa-c664-4d2a-9c5e-c612dba613ee None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:39.408189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 201/412] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 15:00:39 2022] PUT /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768/groups/d375f38d0a1f43b391592a1593e1e1ff/roles/47a961686ccc4c6a8bb05e0f3fe5ffba => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:39.447805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca9a7e-ba22-4125-9402-939c6281621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:39.449170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca9a7e-ba22-4125-9402-939c6281621d None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.449896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca9a7e-ba22-4125-9402-939c6281621d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.450370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca9a7e-ba22-4125-9402-939c6281621d None admin] PATH_INFO: `/v3/groups/aa3df68ee79f4743bff5aed1aa353bd0` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.452149 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca9a7e-ba22-4125-9402-939c6281621d None admin] RBAC: Authorizing `identity:get_group(group_id=aa3df68ee79f4743bff5aed1aa353bd0)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:39.454316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca9a7e-ba22-4125-9402-939c6281621d None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.456647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 212/413] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:39 2022] GET /identity/v3/groups/aa3df68ee79f4743bff5aed1aa353bd0 => generated 229 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:39.462631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0c41c-ec39-43ff-9449-e0056bb705c2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.578097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:39.583327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0c41c-ec39-43ff-9449-e0056bb705c2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:39.619846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f931839-8fdb-4a7d-93c8-3063c43cbcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:39.621067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f931839-8fdb-4a7d-93c8-3063c43cbcee None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.621748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f931839-8fdb-4a7d-93c8-3063c43cbcee None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.622216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f931839-8fdb-4a7d-93c8-3063c43cbcee None admin] PATH_INFO: `/v3/projects/94e02961c51b473ebdfc8f91d292091e` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.623647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f931839-8fdb-4a7d-93c8-3063c43cbcee None admin] RBAC: Authorizing `identity:get_project(project_id=94e02961c51b473ebdfc8f91d292091e)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:39.625301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f931839-8fdb-4a7d-93c8-3063c43cbcee None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.627528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 202/414] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:39 2022] GET /identity/v3/projects/94e02961c51b473ebdfc8f91d292091e => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:39.633667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca9a7e-ba22-4125-9402-939c6281621d None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:39.661208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:39.744812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca9a7e-ba22-4125-9402-939c6281621d None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:39.796580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59424c6f-a9c3-4f46-878e-310fb44cb5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:39.797471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59424c6f-a9c3-4f46-878e-310fb44cb5f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:39.797747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59424c6f-a9c3-4f46-878e-310fb44cb5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:39.798021 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59424c6f-a9c3-4f46-878e-310fb44cb5f3 None admin] PATH_INFO: `/v3/projects/94e02961c51b473ebdfc8f91d292091e/groups/aa3df68ee79f4743bff5aed1aa353bd0/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:39.799983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59424c6f-a9c3-4f46-878e-310fb44cb5f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=94e02961c51b473ebdfc8f91d292091e, group_id=aa3df68ee79f4743bff5aed1aa353bd0, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:39.801428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59424c6f-a9c3-4f46-878e-310fb44cb5f3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:39.822443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 213/415] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 15:00:39 2022] PUT /identity/v3/projects/94e02961c51b473ebdfc8f91d292091e/groups/aa3df68ee79f4743bff5aed1aa353bd0/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:00:40.483814 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8c656-6c4f-4ed5-a862-7072dbdfc776 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.484766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8c656-6c4f-4ed5-a862-7072dbdfc776 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.485234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8c656-6c4f-4ed5-a862-7072dbdfc776 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.487069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 203/416] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:40.492707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02edf1-e066-4bf6-aeda-80d19796df3c None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.493559 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02edf1-e066-4bf6-aeda-80d19796df3c None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.494031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02edf1-e066-4bf6-aeda-80d19796df3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.519688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-5f02edf1-e066-4bf6-aeda-80d19796df3c None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:40.521363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-5f02edf1-e066-4bf6-aeda-80d19796df3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:40.550956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a1d60-be34-41ab-b0ab-db7996f07025 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.551288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a1d60-be34-41ab-b0ab-db7996f07025 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.551515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a1d60-be34-41ab-b0ab-db7996f07025 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.553165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 204/417] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:40.558494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b6781-7d50-4b64-b419-13911777e03e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.558789 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b6781-7d50-4b64-b419-13911777e03e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.559077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b6781-7d50-4b64-b419-13911777e03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.604602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9b1b6781-7d50-4b64-b419-13911777e03e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:40.606887 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9b1b6781-7d50-4b64-b419-13911777e03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:40.611307 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 214/418] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:40.642601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02edf1-e066-4bf6-aeda-80d19796df3c None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.661964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:40.716964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 205/419] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:40.739836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b6781-7d50-4b64-b419-13911777e03e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.830453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02edf1-e066-4bf6-aeda-80d19796df3c None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:40.839172 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:40.845953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b6781-7d50-4b64-b419-13911777e03e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:40.883537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559cd2c-b392-42c1-94ae-9d76899495af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:40.884838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559cd2c-b392-42c1-94ae-9d76899495af None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.885312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559cd2c-b392-42c1-94ae-9d76899495af None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.885799 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559cd2c-b392-42c1-94ae-9d76899495af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.899405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559cd2c-b392-42c1-94ae-9d76899495af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-5559cd2c-b392-42c1-94ae-9d76899495af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:40.909209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:40.910192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:40.910989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:40.910989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:40.910989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:40.910989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:40.910989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:40.910989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:40.910989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:40.910989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:40.910989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:40.910989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:40.910989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:40.910989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:40.911622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74424f-ae70-4489-8ad7-298651570bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:40.911622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74424f-ae70-4489-8ad7-298651570bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:40.911622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74424f-ae70-4489-8ad7-298651570bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:40.911622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74424f-ae70-4489-8ad7-298651570bf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:40.914349 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 206/420] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:00:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:40.920840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559cd2c-b392-42c1-94ae-9d76899495af None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:40.935516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74424f-ae70-4489-8ad7-298651570bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-cf74424f-ae70-4489-8ad7-298651570bf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:40.943453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:40.944341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:40.945328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:40.945328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:40.945328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:40.945328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:40.945328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:40.945328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:40.945328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:40.945328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:40.945328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:40.945328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:40.945328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:40.945328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:40.949034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 215/421] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:40.952370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74424f-ae70-4489-8ad7-298651570bf7 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.070780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.102165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559cd2c-b392-42c1-94ae-9d76899495af None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.104084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74424f-ae70-4489-8ad7-298651570bf7 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.144203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69954369-cae1-4e48-ab6b-306e651cc1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.145241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69954369-cae1-4e48-ab6b-306e651cc1dc None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.145703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0b817-4c10-4f45-97e7-a9b8864ca218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.145975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69954369-cae1-4e48-ab6b-306e651cc1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.146386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b817-4c10-4f45-97e7-a9b8864ca218 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.146650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69954369-cae1-4e48-ab6b-306e651cc1dc None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.146765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b817-4c10-4f45-97e7-a9b8864ca218 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.146945 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b817-4c10-4f45-97e7-a9b8864ca218 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.147711 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0b817-4c10-4f45-97e7-a9b8864ca218 None admin] RBAC: Adding query filter params (name=member) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:41.148055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0b817-4c10-4f45-97e7-a9b8864ca218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.148376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69954369-cae1-4e48-ab6b-306e651cc1dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:41.148872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69954369-cae1-4e48-ab6b-306e651cc1dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.149439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0b817-4c10-4f45-97e7-a9b8864ca218 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.150657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69954369-cae1-4e48-ab6b-306e651cc1dc None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.159901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 207/422] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:41.160203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 216/423] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:41.161447 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad9070-1bc6-44bb-a536-dc992b256f7e None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.161734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad9070-1bc6-44bb-a536-dc992b256f7e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.162008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad9070-1bc6-44bb-a536-dc992b256f7e None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.163368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 217/424] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:41.165073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69954369-cae1-4e48-ab6b-306e651cc1dc None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.168796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ad682-a0ab-4bd2-9905-bd86ef6619e4 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.170476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ad682-a0ab-4bd2-9905-bd86ef6619e4 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.170954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ad682-a0ab-4bd2-9905-bd86ef6619e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.187099 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.193643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-6d0ad682-a0ab-4bd2-9905-bd86ef6619e4 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:41.194966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-6d0ad682-a0ab-4bd2-9905-bd86ef6619e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:41.278131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 218/425] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:41.279540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ad682-a0ab-4bd2-9905-bd86ef6619e4 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.305684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69954369-cae1-4e48-ab6b-306e651cc1dc None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.340449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94726e6-6b30-41fe-b672-6eeb8a29e0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.341090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94726e6-6b30-41fe-b672-6eeb8a29e0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.341377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94726e6-6b30-41fe-b672-6eeb8a29e0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.341656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94726e6-6b30-41fe-b672-6eeb8a29e0e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.374677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.413258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94726e6-6b30-41fe-b672-6eeb8a29e0e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.414763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94726e6-6b30-41fe-b672-6eeb8a29e0e2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.419953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ad682-a0ab-4bd2-9905-bd86ef6619e4 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.433771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.462568 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16c681-0454-449b-ba8e-db17bc62a769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.463234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16c681-0454-449b-ba8e-db17bc62a769 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.463518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16c681-0454-449b-ba8e-db17bc62a769 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.463824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16c681-0454-449b-ba8e-db17bc62a769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.538507 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16c681-0454-449b-ba8e-db17bc62a769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.540047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16c681-0454-449b-ba8e-db17bc62a769 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.540919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 208/426] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 15:00:41.541821 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94726e6-6b30-41fe-b672-6eeb8a29e0e2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.610213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.658780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 219/427] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:41.659709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16c681-0454-449b-ba8e-db17bc62a769 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.672931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94726e6-6b30-41fe-b672-6eeb8a29e0e2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.696187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.720021 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb74467-bc2e-4bad-a83b-eaf43edc768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.721165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb74467-bc2e-4bad-a83b-eaf43edc768c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.721683 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb74467-bc2e-4bad-a83b-eaf43edc768c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.722663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb74467-bc2e-4bad-a83b-eaf43edc768c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.742977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb74467-bc2e-4bad-a83b-eaf43edc768c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4fb74467-bc2e-4bad-a83b-eaf43edc768c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:41.756557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:41.757481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:41.758405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:41.758405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:41.758405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:41.758405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:41.758405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:41.758405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:41.758405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:41.758405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:41.758405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:41.758405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:41.758405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:00:41.758405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:41.761078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 209/428] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:41.761728 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb74467-bc2e-4bad-a83b-eaf43edc768c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.783075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16c681-0454-449b-ba8e-db17bc62a769 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.825452 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b78b4d-3812-44a8-bb4e-0e462f928544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.826338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b78b4d-3812-44a8-bb4e-0e462f928544 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.826668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b78b4d-3812-44a8-bb4e-0e462f928544 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.826955 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b78b4d-3812-44a8-bb4e-0e462f928544 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.828261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b78b4d-3812-44a8-bb4e-0e462f928544 None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.830047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b78b4d-3812-44a8-bb4e-0e462f928544 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.835639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 220/429] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:41 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:41.836719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b78b4d-3812-44a8-bb4e-0e462f928544 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.884753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:41.900798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb74467-bc2e-4bad-a83b-eaf43edc768c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.944697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d866c1-ca50-4ebe-879a-a0329b0474f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.946454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d866c1-ca50-4ebe-879a-a0329b0474f1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.946895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d866c1-ca50-4ebe-879a-a0329b0474f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.947451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d866c1-ca50-4ebe-879a-a0329b0474f1 None admin] PATH_INFO: `/v3/projects/903a0b97a2f547ba915abf85091b8d33` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.949323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d866c1-ca50-4ebe-879a-a0329b0474f1 None admin] RBAC: Authorizing `identity:get_project(project_id=903a0b97a2f547ba915abf85091b8d33)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.950990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b78b4d-3812-44a8-bb4e-0e462f928544 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:41.951259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d866c1-ca50-4ebe-879a-a0329b0474f1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:41.955096 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 210/430] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:41 2022] GET /identity/v3/projects/903a0b97a2f547ba915abf85091b8d33 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:41.956124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d866c1-ca50-4ebe-879a-a0329b0474f1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:41.991464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04829e10-5996-4259-a3f7-05731f539026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:41.992329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04829e10-5996-4259-a3f7-05731f539026 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:41.992914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04829e10-5996-4259-a3f7-05731f539026 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:41.993042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04829e10-5996-4259-a3f7-05731f539026 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:41.993881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04829e10-5996-4259-a3f7-05731f539026 None admin] RBAC: Adding query filter params (name=member) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:41.994178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04829e10-5996-4259-a3f7-05731f539026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:41.995684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04829e10-5996-4259-a3f7-05731f539026 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:42.010109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 221/431] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:00:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:42.011028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04829e10-5996-4259-a3f7-05731f539026 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:42.014832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:42.078488 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d866c1-ca50-4ebe-879a-a0329b0474f1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:42.120091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb42ba-ef35-4467-beca-ee92f8a5416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:42.121072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb42ba-ef35-4467-beca-ee92f8a5416a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.121430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb42ba-ef35-4467-beca-ee92f8a5416a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.121780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb42ba-ef35-4467-beca-ee92f8a5416a None admin] PATH_INFO: `/v3/groups/d375f38d0a1f43b391592a1593e1e1ff` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.123070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb42ba-ef35-4467-beca-ee92f8a5416a None admin] RBAC: Authorizing `identity:get_group(group_id=d375f38d0a1f43b391592a1593e1e1ff)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:42.124814 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb42ba-ef35-4467-beca-ee92f8a5416a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:42.131831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 211/432] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:41 2022] GET /identity/v3/groups/d375f38d0a1f43b391592a1593e1e1ff => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:42.132615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:42.134054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb42ba-ef35-4467-beca-ee92f8a5416a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:42.137042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04829e10-5996-4259-a3f7-05731f539026 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:42.172779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa455579-fc05-44de-a149-715747cfc525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:42.173954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455579-fc05-44de-a149-715747cfc525 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.174403 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455579-fc05-44de-a149-715747cfc525 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.174894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455579-fc05-44de-a149-715747cfc525 None admin] PATH_INFO: `/v3/groups/d375f38d0a1f43b391592a1593e1e1ff` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.176302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa455579-fc05-44de-a149-715747cfc525 None admin] RBAC: Authorizing `identity:get_group(group_id=d375f38d0a1f43b391592a1593e1e1ff)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:42.177950 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa455579-fc05-44de-a149-715747cfc525 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:42.180218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 222/433] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:42 2022] GET /identity/v3/groups/d375f38d0a1f43b391592a1593e1e1ff => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:42.181213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa455579-fc05-44de-a149-715747cfc525 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:42.252300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb42ba-ef35-4467-beca-ee92f8a5416a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:42.268523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:42.287412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa455579-fc05-44de-a149-715747cfc525 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:42.288756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cec9b0-1393-4fa6-9d3c-8d8ad8370582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:42.289446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cec9b0-1393-4fa6-9d3c-8d8ad8370582 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.289723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cec9b0-1393-4fa6-9d3c-8d8ad8370582 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.290637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cec9b0-1393-4fa6-9d3c-8d8ad8370582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.323919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec7f25-6e99-4655-9ee8-38cc5b11f103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:42.324589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec7f25-6e99-4655-9ee8-38cc5b11f103 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.324870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec7f25-6e99-4655-9ee8-38cc5b11f103 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.325146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec7f25-6e99-4655-9ee8-38cc5b11f103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.326030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec7f25-6e99-4655-9ee8-38cc5b11f103 None admin] RBAC: Adding query filter params (group.id=d375f38d0a1f43b391592a1593e1e1ff, role.id=47a961686ccc4c6a8bb05e0f3fe5ffba, scope.project.id=903a0b97a2f547ba915abf85091b8d33) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:42.326545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec7f25-6e99-4655-9ee8-38cc5b11f103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:42.328018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec7f25-6e99-4655-9ee8-38cc5b11f103 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:42.333973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 223/434] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 15:00:42 2022] GET /identity/v3/role_assignments?group.id=d375f38d0a1f43b391592a1593e1e1ff&scope.project.id=903a0b97a2f547ba915abf85091b8d33&role.id=47a961686ccc4c6a8bb05e0f3fe5ffba => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:42.334752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec7f25-6e99-4655-9ee8-38cc5b11f103 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:42.365312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:42.375998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cec9b0-1393-4fa6-9d3c-8d8ad8370582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:42.377785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cec9b0-1393-4fa6-9d3c-8d8ad8370582 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:42.456605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec7f25-6e99-4655-9ee8-38cc5b11f103 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:42.495025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfbf24-6481-4e12-9311-a6d3bbcf74cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:42.495721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfbf24-6481-4e12-9311-a6d3bbcf74cd None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.496164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfbf24-6481-4e12-9311-a6d3bbcf74cd None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.496575 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfbf24-6481-4e12-9311-a6d3bbcf74cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.497598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfbf24-6481-4e12-9311-a6d3bbcf74cd None admin] RBAC: Adding query filter params (group.id=d375f38d0a1f43b391592a1593e1e1ff, role.id=88c41930377947b7a1dc0134ba0f787b, scope.project.id=903a0b97a2f547ba915abf85091b8d33) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:42.498092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfbf24-6481-4e12-9311-a6d3bbcf74cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:42.499788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfbf24-6481-4e12-9311-a6d3bbcf74cd None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:42.502048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 212/435] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:42.503938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3783e-5f56-4a1b-92c0-66d51f5c5cbf None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.504423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3783e-5f56-4a1b-92c0-66d51f5c5cbf None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.504847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3783e-5f56-4a1b-92c0-66d51f5c5cbf None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.506725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 213/436] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:42.507146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 224/437] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 15:00:42 2022] GET /identity/v3/role_assignments?group.id=d375f38d0a1f43b391592a1593e1e1ff&scope.project.id=903a0b97a2f547ba915abf85091b8d33&role.id=88c41930377947b7a1dc0134ba0f787b => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:42.507893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3783e-5f56-4a1b-92c0-66d51f5c5cbf None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:42.517414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcaa49-9bbf-4d15-b2a3-d8e4543279d1 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.517807 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcaa49-9bbf-4d15-b2a3-d8e4543279d1 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.518183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcaa49-9bbf-4d15-b2a3-d8e4543279d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.527931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:42.549669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-7dfcaa49-9bbf-4d15-b2a3-d8e4543279d1 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:42.551556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-7dfcaa49-9bbf-4d15-b2a3-d8e4543279d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:42.626797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 225/438] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:42.629064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2399030-1b68-48b0-819b-702f69fc4ceb None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.629599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2399030-1b68-48b0-819b-702f69fc4ceb None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.629704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2399030-1b68-48b0-819b-702f69fc4ceb None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.631061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 226/439] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:42.637296 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ecf6c-1a25-4ac9-8c79-ef58467f2673 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.637893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ecf6c-1a25-4ac9-8c79-ef58467f2673 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.638679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ecf6c-1a25-4ac9-8c79-ef58467f2673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.641330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3783e-5f56-4a1b-92c0-66d51f5c5cbf None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:42.662685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-4f0ecf6c-1a25-4ac9-8c79-ef58467f2673 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:42.663968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-4f0ecf6c-1a25-4ac9-8c79-ef58467f2673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:42.684644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:42.688560 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575502e-4a76-48d6-9a82-d84e4c86db1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:42.689797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575502e-4a76-48d6-9a82-d84e4c86db1b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.690283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575502e-4a76-48d6-9a82-d84e4c86db1b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.690748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575502e-4a76-48d6-9a82-d84e4c86db1b None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.692076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575502e-4a76-48d6-9a82-d84e4c86db1b None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:42.694724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575502e-4a76-48d6-9a82-d84e4c86db1b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:42.697237 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 214/440] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:42 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:42.698254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575502e-4a76-48d6-9a82-d84e4c86db1b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:42.747756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 227/441] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:42.749198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ecf6c-1a25-4ac9-8c79-ef58467f2673 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:42.792860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:42.817762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575502e-4a76-48d6-9a82-d84e4c86db1b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:42.857096 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec63f57-e29a-4a37-8772-78584dd6f0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:42.858226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec63f57-e29a-4a37-8772-78584dd6f0fa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.858688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec63f57-e29a-4a37-8772-78584dd6f0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.858965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec63f57-e29a-4a37-8772-78584dd6f0fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.866603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ecf6c-1a25-4ac9-8c79-ef58467f2673 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:42.870037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec63f57-e29a-4a37-8772-78584dd6f0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-bec63f57-e29a-4a37-8772-78584dd6f0fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:42.878582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:42.879765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:42.880716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:42.880716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:42.880716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:42.880716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:42.880716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:42.880716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:42.880716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:42.880716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:42.880716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:42.880716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:42.880716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:42.880716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:42.882820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 215/442] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:00:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:42.883810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec63f57-e29a-4a37-8772-78584dd6f0fa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:42.913638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a05d30-32f2-4081-8451-f72ab21cee53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:42.914522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a05d30-32f2-4081-8451-f72ab21cee53 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:42.914841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a05d30-32f2-4081-8451-f72ab21cee53 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:42.915116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a05d30-32f2-4081-8451-f72ab21cee53 None admin] PATH_INFO: `/v3/groups/d375f38d0a1f43b391592a1593e1e1ff` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:42.916435 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a05d30-32f2-4081-8451-f72ab21cee53 None admin] RBAC: Authorizing `identity:get_group(group_id=d375f38d0a1f43b391592a1593e1e1ff)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:42.918324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a05d30-32f2-4081-8451-f72ab21cee53 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:42.919535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 228/443] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:42 2022] GET /identity/v3/groups/d375f38d0a1f43b391592a1593e1e1ff => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:42.920404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a05d30-32f2-4081-8451-f72ab21cee53 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:42.943284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:43.008786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec63f57-e29a-4a37-8772-78584dd6f0fa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:43.030666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a05d30-32f2-4081-8451-f72ab21cee53 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:43.050051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604092c-a310-4d7b-bb14-012b564c85f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:43.050865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604092c-a310-4d7b-bb14-012b564c85f5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.051145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604092c-a310-4d7b-bb14-012b564c85f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.051408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604092c-a310-4d7b-bb14-012b564c85f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.062620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604092c-a310-4d7b-bb14-012b564c85f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7604092c-a310-4d7b-bb14-012b564c85f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:43.070430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:43.071401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:43.072274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 216/444] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:00:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:43.072931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604092c-a310-4d7b-bb14-012b564c85f5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:43.076462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:43.078321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ddcf9-6f2d-4b45-8c37-119c403a6784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:43.079049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ddcf9-6f2d-4b45-8c37-119c403a6784 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.079334 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ddcf9-6f2d-4b45-8c37-119c403a6784 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.080306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ddcf9-6f2d-4b45-8c37-119c403a6784 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.080579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ddcf9-6f2d-4b45-8c37-119c403a6784 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:43.080891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ddcf9-6f2d-4b45-8c37-119c403a6784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:43.082281 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ddcf9-6f2d-4b45-8c37-119c403a6784 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:43.091997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 229/445] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:43.092829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ddcf9-6f2d-4b45-8c37-119c403a6784 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:43.176951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:43.185047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604092c-a310-4d7b-bb14-012b564c85f5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:43.196849 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ddcf9-6f2d-4b45-8c37-119c403a6784 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:43.218344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bd19e-0fec-4e25-a2e2-b9d26081866c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:43.218997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bd19e-0fec-4e25-a2e2-b9d26081866c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.219279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bd19e-0fec-4e25-a2e2-b9d26081866c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.219545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bd19e-0fec-4e25-a2e2-b9d26081866c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.220411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bd19e-0fec-4e25-a2e2-b9d26081866c None admin] RBAC: Adding query filter params (group.id=d375f38d0a1f43b391592a1593e1e1ff, role.id=88c41930377947b7a1dc0134ba0f787b, scope.project.id=17512cd0708a4c7aa66913e0ed2c1768) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:43.220724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bd19e-0fec-4e25-a2e2-b9d26081866c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:43.222170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991bd19e-0fec-4e25-a2e2-b9d26081866c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:43.228374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 217/446] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 15:00:43 2022] GET /identity/v3/role_assignments?group.id=d375f38d0a1f43b391592a1593e1e1ff&scope.project.id=17512cd0708a4c7aa66913e0ed2c1768&role.id=88c41930377947b7a1dc0134ba0f787b => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:43.229476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bd19e-0fec-4e25-a2e2-b9d26081866c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:43.234854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df2b1a-e119-49db-bffe-55bfdd12344e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:43.235548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df2b1a-e119-49db-bffe-55bfdd12344e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.235856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df2b1a-e119-49db-bffe-55bfdd12344e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.236135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df2b1a-e119-49db-bffe-55bfdd12344e None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.236909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df2b1a-e119-49db-bffe-55bfdd12344e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:43.237217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df2b1a-e119-49db-bffe-55bfdd12344e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:43.238628 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df2b1a-e119-49db-bffe-55bfdd12344e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:43.249349 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 230/447] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:43.255242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df2b1a-e119-49db-bffe-55bfdd12344e None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:43.323129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:43.365642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bd19e-0fec-4e25-a2e2-b9d26081866c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:43.368989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df2b1a-e119-49db-bffe-55bfdd12344e None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:43.402733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c463f03-e278-4f04-b0d4-97953fd619a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:43.403398 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c463f03-e278-4f04-b0d4-97953fd619a0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.403714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c463f03-e278-4f04-b0d4-97953fd619a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.403994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c463f03-e278-4f04-b0d4-97953fd619a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.407055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869347b-2ece-4a79-9347-af2eb45d70f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:43.407752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869347b-2ece-4a79-9347-af2eb45d70f6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.408035 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869347b-2ece-4a79-9347-af2eb45d70f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.408310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869347b-2ece-4a79-9347-af2eb45d70f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.424911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:43.485441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c463f03-e278-4f04-b0d4-97953fd619a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:43.486919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c463f03-e278-4f04-b0d4-97953fd619a0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:43.496347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869347b-2ece-4a79-9347-af2eb45d70f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:43.498495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869347b-2ece-4a79-9347-af2eb45d70f6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:43.559661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:43.602069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 218/448] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:43.607919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c463f03-e278-4f04-b0d4-97953fd619a0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:43.616849 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 231/449] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 15:00:43.623196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869347b-2ece-4a79-9347-af2eb45d70f6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:43.667410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:43.713608 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c463f03-e278-4f04-b0d4-97953fd619a0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:43.720626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869347b-2ece-4a79-9347-af2eb45d70f6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:43.746015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd596a1-316f-404f-8ed1-b4c44bacce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:43.746897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd596a1-316f-404f-8ed1-b4c44bacce6c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.747178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd596a1-316f-404f-8ed1-b4c44bacce6c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.747452 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd596a1-316f-404f-8ed1-b4c44bacce6c None admin] PATH_INFO: `/v3/projects/17512cd0708a4c7aa66913e0ed2c1768` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.748677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd596a1-316f-404f-8ed1-b4c44bacce6c None admin] RBAC: Authorizing `identity:get_project(project_id=17512cd0708a4c7aa66913e0ed2c1768)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:43.750117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd596a1-316f-404f-8ed1-b4c44bacce6c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:43.751838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 219/450] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:43 2022] GET /identity/v3/projects/17512cd0708a4c7aa66913e0ed2c1768 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:43.753445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fc123-d73c-47cb-8042-e770210761d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:43.754318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fc123-d73c-47cb-8042-e770210761d1 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.754595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fc123-d73c-47cb-8042-e770210761d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.754865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fc123-d73c-47cb-8042-e770210761d1 None admin] PATH_INFO: `/v3/projects/94e02961c51b473ebdfc8f91d292091e` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.756167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fc123-d73c-47cb-8042-e770210761d1 None admin] RBAC: Authorizing `identity:get_project(project_id=94e02961c51b473ebdfc8f91d292091e)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:43.757173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd596a1-316f-404f-8ed1-b4c44bacce6c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:43.757597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fc123-d73c-47cb-8042-e770210761d1 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:43.763527 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 232/451] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:00:43 2022] GET /identity/v3/projects/94e02961c51b473ebdfc8f91d292091e => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:43.764903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fc123-d73c-47cb-8042-e770210761d1 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:43.789639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:43.854179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd596a1-316f-404f-8ed1-b4c44bacce6c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:43.860203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fc123-d73c-47cb-8042-e770210761d1 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:43.872907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:43.886963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fc116-9f8d-4f7a-9812-28871e446bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:43.887860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fc116-9f8d-4f7a-9812-28871e446bfd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.888147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fc116-9f8d-4f7a-9812-28871e446bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.888426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fc116-9f8d-4f7a-9812-28871e446bfd None admin] PATH_INFO: `/v3/groups/d375f38d0a1f43b391592a1593e1e1ff` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.889922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fc116-9f8d-4f7a-9812-28871e446bfd None admin] RBAC: Authorizing `identity:get_group(group_id=d375f38d0a1f43b391592a1593e1e1ff)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:43.891367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fc116-9f8d-4f7a-9812-28871e446bfd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:43.893224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 220/452] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:43 2022] GET /identity/v3/groups/d375f38d0a1f43b391592a1593e1e1ff => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:43.894845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780d12-24df-48ee-85bf-3dbd6bac4cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:43.895755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780d12-24df-48ee-85bf-3dbd6bac4cca None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:43.896041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780d12-24df-48ee-85bf-3dbd6bac4cca None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:43.896319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780d12-24df-48ee-85bf-3dbd6bac4cca None admin] PATH_INFO: `/v3/groups/aa3df68ee79f4743bff5aed1aa353bd0` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:43.897503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39780d12-24df-48ee-85bf-3dbd6bac4cca None admin] RBAC: Authorizing `identity:get_group(group_id=aa3df68ee79f4743bff5aed1aa353bd0)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:43.898703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fc116-9f8d-4f7a-9812-28871e446bfd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:43.898934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39780d12-24df-48ee-85bf-3dbd6bac4cca None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:43.900645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 233/453] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 15:00:43 2022] GET /identity/v3/groups/aa3df68ee79f4743bff5aed1aa353bd0 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:43.906147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780d12-24df-48ee-85bf-3dbd6bac4cca None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:43.998680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fc116-9f8d-4f7a-9812-28871e446bfd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:44.000217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:44.005921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780d12-24df-48ee-85bf-3dbd6bac4cca None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:44.033102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef29217-dc25-4a32-b8a2-d69a211c2d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:44.033759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef29217-dc25-4a32-b8a2-d69a211c2d19 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:44.034041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef29217-dc25-4a32-b8a2-d69a211c2d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:44.034316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef29217-dc25-4a32-b8a2-d69a211c2d19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:44.035164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef29217-dc25-4a32-b8a2-d69a211c2d19 None admin] RBAC: Adding query filter params (group.id=d375f38d0a1f43b391592a1593e1e1ff, role.id=47a961686ccc4c6a8bb05e0f3fe5ffba, scope.project.id=17512cd0708a4c7aa66913e0ed2c1768) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:44.035475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef29217-dc25-4a32-b8a2-d69a211c2d19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:44.036948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef29217-dc25-4a32-b8a2-d69a211c2d19 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:44.039486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc336318-86ef-4663-8fd3-85bd66b56d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:44.040172 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc336318-86ef-4663-8fd3-85bd66b56d24 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:44.040511 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc336318-86ef-4663-8fd3-85bd66b56d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:44.040795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc336318-86ef-4663-8fd3-85bd66b56d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:44.041643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc336318-86ef-4663-8fd3-85bd66b56d24 None admin] RBAC: Adding query filter params (group.id=aa3df68ee79f4743bff5aed1aa353bd0, role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=94e02961c51b473ebdfc8f91d292091e) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:44.041960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc336318-86ef-4663-8fd3-85bd66b56d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:44.043191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 221/454] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 15:00:43 2022] GET /identity/v3/role_assignments?group.id=d375f38d0a1f43b391592a1593e1e1ff&scope.project.id=17512cd0708a4c7aa66913e0ed2c1768&role.id=47a961686ccc4c6a8bb05e0f3fe5ffba => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:44.043382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc336318-86ef-4663-8fd3-85bd66b56d24 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:44.055735 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 234/455] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 15:00:43 2022] GET /identity/v3/role_assignments?group.id=aa3df68ee79f4743bff5aed1aa353bd0&scope.project.id=94e02961c51b473ebdfc8f91d292091e&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:46.861408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a09e01-4d62-4d55-ae0b-f93586f1d4f8 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:46.862468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a09e01-4d62-4d55-ae0b-f93586f1d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:46.862979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a09e01-4d62-4d55-ae0b-f93586f1d4f8 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:46.864841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 222/456] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:46.870664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fefa8d-8030-4245-887d-fb0e459498b1 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:46.871483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fefa8d-8030-4245-887d-fb0e459498b1 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:46.871985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fefa8d-8030-4245-887d-fb0e459498b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:46.897659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-c7fefa8d-8030-4245-887d-fb0e459498b1 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:46.899198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-c7fefa8d-8030-4245-887d-fb0e459498b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:46.964530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:46.967964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa092408-4c92-45fc-8d33-371d1ba55d87 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:46.968493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa092408-4c92-45fc-8d33-371d1ba55d87 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:46.969111 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa092408-4c92-45fc-8d33-371d1ba55d87 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:46.972545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 223/457] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:46.978276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f9f6c-598a-4bf4-bed1-55ef60452a06 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:46.978568 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f9f6c-598a-4bf4-bed1-55ef60452a06 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:46.978851 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f9f6c-598a-4bf4-bed1-55ef60452a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.008307 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-dc3f9f6c-598a-4bf4-bed1-55ef60452a06 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:47.009521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dc3f9f6c-598a-4bf4-bed1-55ef60452a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:47.027921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 235/458] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:00:47.088010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fefa8d-8030-4245-887d-fb0e459498b1 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:47.109912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 224/459] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:47.152386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f9f6c-598a-4bf4-bed1-55ef60452a06 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:47.199970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fefa8d-8030-4245-887d-fb0e459498b1 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:47.252552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8563fbe-02e6-4780-82a7-eaa9c89ac1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:47.253129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8563fbe-02e6-4780-82a7-eaa9c89ac1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.253418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8563fbe-02e6-4780-82a7-eaa9c89ac1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.253702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8563fbe-02e6-4780-82a7-eaa9c89ac1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.274500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8563fbe-02e6-4780-82a7-eaa9c89ac1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:47.276020 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8563fbe-02e6-4780-82a7-eaa9c89ac1a7 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:47.292641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f9f6c-598a-4bf4-bed1-55ef60452a06 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:47.295887 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-d8563fbe-02e6-4780-82a7-eaa9c89ac1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:47.309537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:47.310493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:47.311359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:47.311359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:47.311359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:47.311359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:47.311359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 236/460] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:47.316885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8563fbe-02e6-4780-82a7-eaa9c89ac1a7 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:47.356056 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a87d1c-281a-46c0-9d77-2ebf8f39992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:47.356877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a87d1c-281a-46c0-9d77-2ebf8f39992f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.357161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a87d1c-281a-46c0-9d77-2ebf8f39992f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.357440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a87d1c-281a-46c0-9d77-2ebf8f39992f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.374763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:47.381041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a87d1c-281a-46c0-9d77-2ebf8f39992f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:47.382523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a87d1c-281a-46c0-9d77-2ebf8f39992f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-58a87d1c-281a-46c0-9d77-2ebf8f39992f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:47.413949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:47.414844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:47.415727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:47.415727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:47.415727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:47.415727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:47.419696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 225/461] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:47.421170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab782fc2-773f-4b9e-bb10-768893df77fd None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.421459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab782fc2-773f-4b9e-bb10-768893df77fd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.421736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab782fc2-773f-4b9e-bb10-768893df77fd None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.427535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 226/462] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:47.427535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab782fc2-773f-4b9e-bb10-768893df77fd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:47.488723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8563fbe-02e6-4780-82a7-eaa9c89ac1a7 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:47.526993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c252a-6f15-4d84-83f9-8c8a24abb403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:47.527697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c252a-6f15-4d84-83f9-8c8a24abb403 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.527989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c252a-6f15-4d84-83f9-8c8a24abb403 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.528272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c252a-6f15-4d84-83f9-8c8a24abb403 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.529069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c252a-6f15-4d84-83f9-8c8a24abb403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:47.529654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c252a-6f15-4d84-83f9-8c8a24abb403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:47.531130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c252a-6f15-4d84-83f9-8c8a24abb403 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:47.543065 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 237/463] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:47.544974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd44aa-f12d-4054-96c9-974966310b61 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.545362 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd44aa-f12d-4054-96c9-974966310b61 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.545736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd44aa-f12d-4054-96c9-974966310b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.562391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab782fc2-773f-4b9e-bb10-768893df77fd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:47.562558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-13dd44aa-f12d-4054-96c9-974966310b61 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:47.563848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-13dd44aa-f12d-4054-96c9-974966310b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:47.600294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a26520-79a8-4631-8ac1-f55c14ae831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:47.600972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a26520-79a8-4631-8ac1-f55c14ae831b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.601257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a26520-79a8-4631-8ac1-f55c14ae831b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.601536 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a26520-79a8-4631-8ac1-f55c14ae831b None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.602276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a26520-79a8-4631-8ac1-f55c14ae831b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:47.602589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a26520-79a8-4631-8ac1-f55c14ae831b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:47.604018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a26520-79a8-4631-8ac1-f55c14ae831b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:47.615813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 227/464] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:47.617124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a47f9d-b604-4d62-ba6b-ef59fdc5ca53 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.617420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a47f9d-b604-4d62-ba6b-ef59fdc5ca53 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.617696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a47f9d-b604-4d62-ba6b-ef59fdc5ca53 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.623371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 228/465] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:47.623371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a47f9d-b604-4d62-ba6b-ef59fdc5ca53 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:47.635175 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:47.636612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 238/466] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:47.637755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd44aa-f12d-4054-96c9-974966310b61 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:47.666626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:47.735495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a47f9d-b604-4d62-ba6b-ef59fdc5ca53 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:47.752145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd44aa-f12d-4054-96c9-974966310b61 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:47.777680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b39bdc-65cb-4003-935d-a2ab7f0a60a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:47.778365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b39bdc-65cb-4003-935d-a2ab7f0a60a0 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.778653 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b39bdc-65cb-4003-935d-a2ab7f0a60a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.778931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b39bdc-65cb-4003-935d-a2ab7f0a60a0 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.779686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b39bdc-65cb-4003-935d-a2ab7f0a60a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:47.781141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b39bdc-65cb-4003-935d-a2ab7f0a60a0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:47.787357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e0b87-cfc5-4773-9f71-76dcbaa55b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:47.788065 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e0b87-cfc5-4773-9f71-76dcbaa55b04 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.788349 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e0b87-cfc5-4773-9f71-76dcbaa55b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.788627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e0b87-cfc5-4773-9f71-76dcbaa55b04 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.789329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e0b87-cfc5-4773-9f71-76dcbaa55b04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:47.790769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e0b87-cfc5-4773-9f71-76dcbaa55b04 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:47.802948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 229/467] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:00:47 2022] POST /identity/v3/users => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:47.815623 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 239/468] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:00:47 2022] POST /identity/v3/users => generated 248 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:47.815829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb4fe8-abb5-4e26-809b-073394dfbea2 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:47.815945 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e0b87-cfc5-4773-9f71-76dcbaa55b04 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:47.816019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb4fe8-abb5-4e26-809b-073394dfbea2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:47.816019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb4fe8-abb5-4e26-809b-073394dfbea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:47.852582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2ddb4fe8-abb5-4e26-809b-073394dfbea2 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:47.854900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2ddb4fe8-abb5-4e26-809b-073394dfbea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:47.974001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:47.995615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:48.013693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 230/469] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:48.032301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e0b87-cfc5-4773-9f71-76dcbaa55b04 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:48.041602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb4fe8-abb5-4e26-809b-073394dfbea2 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:48.078914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d700e8-4fb1-466b-b602-d3699118ad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:48.079773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d700e8-4fb1-466b-b602-d3699118ad10 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:48.080065 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d700e8-4fb1-466b-b602-d3699118ad10 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:48.080341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d700e8-4fb1-466b-b602-d3699118ad10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:48.092239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d700e8-4fb1-466b-b602-d3699118ad10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:48.093731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d700e8-4fb1-466b-b602-d3699118ad10 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-28d700e8-4fb1-466b-b602-d3699118ad10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:48.111538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:48.112493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:48.113598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:48.113598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:48.113598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:48.113598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:48.113598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 240/470] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:48.119049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d700e8-4fb1-466b-b602-d3699118ad10 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:48.179255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb4fe8-abb5-4e26-809b-073394dfbea2 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:48.231505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e0669-373f-4606-9a2c-f71a5f423b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:48.232515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e0669-373f-4606-9a2c-f71a5f423b98 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:48.232803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e0669-373f-4606-9a2c-f71a5f423b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:48.233505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e0669-373f-4606-9a2c-f71a5f423b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:48.243394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d700e8-4fb1-466b-b602-d3699118ad10 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:48.247677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e0669-373f-4606-9a2c-f71a5f423b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:48.249178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e0669-373f-4606-9a2c-f71a5f423b98 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:48.270680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-012e0669-373f-4606-9a2c-f71a5f423b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:48.274522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:48.275501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:48.276439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:48.276439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:48.276439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:48.276439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:48.277582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 231/471] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:48.282129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1956a-9d26-4c16-ae69-7e5dc0c29fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:48.282801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1956a-9d26-4c16-ae69-7e5dc0c29fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:48.283091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1956a-9d26-4c16-ae69-7e5dc0c29fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:48.283374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1956a-9d26-4c16-ae69-7e5dc0c29fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:48.284237 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1956a-9d26-4c16-ae69-7e5dc0c29fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:48.284563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1956a-9d26-4c16-ae69-7e5dc0c29fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:48.285837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e0669-373f-4606-9a2c-f71a5f423b98 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:48.285949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1956a-9d26-4c16-ae69-7e5dc0c29fb8 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:48.301004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 241/472] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:48.308572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1956a-9d26-4c16-ae69-7e5dc0c29fb8 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:48.343211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:48.426286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e0669-373f-4606-9a2c-f71a5f423b98 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:48.444569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1956a-9d26-4c16-ae69-7e5dc0c29fb8 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:48.461693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093a7ee-068f-4d29-9647-0d14822f533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:48.462374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093a7ee-068f-4d29-9647-0d14822f533b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:48.462658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093a7ee-068f-4d29-9647-0d14822f533b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:48.462940 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093a7ee-068f-4d29-9647-0d14822f533b None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:48.463714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093a7ee-068f-4d29-9647-0d14822f533b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:48.464025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093a7ee-068f-4d29-9647-0d14822f533b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:48.465438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093a7ee-068f-4d29-9647-0d14822f533b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:48.477505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 232/473] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:48.478703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80a735-808f-42f7-97d5-d481463c1e48 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:48.478999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80a735-808f-42f7-97d5-d481463c1e48 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:48.479281 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80a735-808f-42f7-97d5-d481463c1e48 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:48.480748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 233/474] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:48.483098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80a735-808f-42f7-97d5-d481463c1e48 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:48.485677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d445a2-a5b5-4e98-97f7-81cdd79060e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:48.486379 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d445a2-a5b5-4e98-97f7-81cdd79060e1 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:48.486671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d445a2-a5b5-4e98-97f7-81cdd79060e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:48.486957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d445a2-a5b5-4e98-97f7-81cdd79060e1 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:48.487748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d445a2-a5b5-4e98-97f7-81cdd79060e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:48.489217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d445a2-a5b5-4e98-97f7-81cdd79060e1 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:48.520269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 242/475] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:00:48 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:48.520269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d114de-a379-46e5-80a5-6caac1f67d18 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:48.520269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d114de-a379-46e5-80a5-6caac1f67d18 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:48.520269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d114de-a379-46e5-80a5-6caac1f67d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:48.547400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-10d114de-a379-46e5-80a5-6caac1f67d18 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:48.549460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-10d114de-a379-46e5-80a5-6caac1f67d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:48.628917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:48.668002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 243/476] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:48.690762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80a735-808f-42f7-97d5-d481463c1e48 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:48.699163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:48.725272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d114de-a379-46e5-80a5-6caac1f67d18 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:48.746199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c2c15-aee3-473a-a496-dcb46e55a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:48.746834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c2c15-aee3-473a-a496-dcb46e55a845 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:48.747118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c2c15-aee3-473a-a496-dcb46e55a845 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:48.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c2c15-aee3-473a-a496-dcb46e55a845 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:48.748144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c2c15-aee3-473a-a496-dcb46e55a845 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:48.749588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c2c15-aee3-473a-a496-dcb46e55a845 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:48.772476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 234/477] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:00:48 2022] POST /identity/v3/users => generated 249 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:48.857022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d114de-a379-46e5-80a5-6caac1f67d18 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:48.895790 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f217a54-d0e2-489b-af66-965d27dc0c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:48.896886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f217a54-d0e2-489b-af66-965d27dc0c40 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:48.897372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f217a54-d0e2-489b-af66-965d27dc0c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:48.897847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f217a54-d0e2-489b-af66-965d27dc0c40 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:48.898861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f217a54-d0e2-489b-af66-965d27dc0c40 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:48.900536 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f217a54-d0e2-489b-af66-965d27dc0c40 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:48.910450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.sql.core [None req-8f217a54-d0e2-489b-af66-965d27dc0c40 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 15:00:48.910450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 15:00:48.910450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [parameters: {'id': '40296788439c4831a8b8a86e9542e045', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 15:00:48.910450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80325) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-8f217a54-d0e2-489b-af66-965d27dc0c40 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application conn.query(q) May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application result.read() May 25 15:00:48.928411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return ref.to_dict() May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:00:48.929395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application next(self.gen) May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application yield resource May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application next(self.gen) May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self.session.rollback() May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self.force_reraise() May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise self.value May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application session.commit() May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 15:00:48.930339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._prepare_impl() May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self.session.flush() May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._flush(objects) May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application compat.raise_( May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application flush_context.execute() May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rec.execute(self) May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 15:00:48.931188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:00:48.932101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application conn.query(q) May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application result.read() May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:00:48.932932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [parameters: {'id': '40296788439c4831a8b8a86e9542e045', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:48.933731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 15:00:48.934621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:48.938789 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 244/478] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 15:00:48 2022] POST /identity/v3/roles => generated 144 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:48.945786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c2c15-aee3-473a-a496-dcb46e55a845 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:49.056211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c2c15-aee3-473a-a496-dcb46e55a845 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:49.090139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee51ee-62a2-465a-9908-08d8e39ef6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:49.091062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee51ee-62a2-465a-9908-08d8e39ef6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:49.091348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee51ee-62a2-465a-9908-08d8e39ef6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:49.091653 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee51ee-62a2-465a-9908-08d8e39ef6f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:49.103115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee51ee-62a2-465a-9908-08d8e39ef6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-5eee51ee-62a2-465a-9908-08d8e39ef6f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:49.111273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:49.113417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:49.115347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 235/479] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:00:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:49.121070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f217a54-d0e2-489b-af66-965d27dc0c40 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:49.157811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:49.225406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f217a54-d0e2-489b-af66-965d27dc0c40 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:49.263112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c65f95-b949-45ce-9b17-deb9e144e9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:49.263868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c65f95-b949-45ce-9b17-deb9e144e9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:49.264152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c65f95-b949-45ce-9b17-deb9e144e9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:49.264432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c65f95-b949-45ce-9b17-deb9e144e9f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:49.265201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c65f95-b949-45ce-9b17-deb9e144e9f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:49.265513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c65f95-b949-45ce-9b17-deb9e144e9f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:49.266902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c65f95-b949-45ce-9b17-deb9e144e9f3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:49.276587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 245/480] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:50.499282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f97ef-9a93-41c2-91c6-0724d2ddb7f9 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:50.499798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f97ef-9a93-41c2-91c6-0724d2ddb7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:50.499906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f97ef-9a93-41c2-91c6-0724d2ddb7f9 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:50.501557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 236/481] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:50.507270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13387d45-09b9-4244-a08d-6d1d85924b67 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:50.508196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13387d45-09b9-4244-a08d-6d1d85924b67 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:50.508676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13387d45-09b9-4244-a08d-6d1d85924b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:50.539790 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-13387d45-09b9-4244-a08d-6d1d85924b67 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:50.541366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-13387d45-09b9-4244-a08d-6d1d85924b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:50.639018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a23b9e-9a8d-4df9-b796-8426a700ce95 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:50.639341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a23b9e-9a8d-4df9-b796-8426a700ce95 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:50.639605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a23b9e-9a8d-4df9-b796-8426a700ce95 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:50.646133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 237/482] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:50.649188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcf447-fcda-4a09-a9a0-b88c197101fb None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:50.649482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcf447-fcda-4a09-a9a0-b88c197101fb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:50.649772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcf447-fcda-4a09-a9a0-b88c197101fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:50.684044 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-aabcf447-fcda-4a09-a9a0-b88c197101fb None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:50.686924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-aabcf447-fcda-4a09-a9a0-b88c197101fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:50.690714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 246/483] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:50.729827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:50.737191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13387d45-09b9-4244-a08d-6d1d85924b67 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:50.780017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:50.808597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 238/484] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:50.845667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcf447-fcda-4a09-a9a0-b88c197101fb None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:50.915726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13387d45-09b9-4244-a08d-6d1d85924b67 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:50.954169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dfae6-4733-4a4e-b34b-20adfff4370b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:50.954992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dfae6-4733-4a4e-b34b-20adfff4370b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:50.955927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dfae6-4733-4a4e-b34b-20adfff4370b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:50.956200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dfae6-4733-4a4e-b34b-20adfff4370b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:50.986710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dfae6-4733-4a4e-b34b-20adfff4370b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-5d5dfae6-4733-4a4e-b34b-20adfff4370b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:51.003010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:51.003943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:51.004755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:51.004755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:51.004755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:51.004755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:51.004755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:51.004755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:51.004755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:51.004755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:51.004755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:51.004755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:51.004755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:51.004755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:51.014976 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 247/485] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:00:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:51.015869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dfae6-4733-4a4e-b34b-20adfff4370b None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:51.122495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcf447-fcda-4a09-a9a0-b88c197101fb None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:51.211230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ea172-e347-4869-ae8e-54537d1ba70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:51.212087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ea172-e347-4869-ae8e-54537d1ba70a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:51.215398 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ea172-e347-4869-ae8e-54537d1ba70a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:51.215729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ea172-e347-4869-ae8e-54537d1ba70a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:51.237785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:51.238139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ea172-e347-4869-ae8e-54537d1ba70a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:51.252206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dfae6-4733-4a4e-b34b-20adfff4370b None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-702ea172-e347-4869-ae8e-54537d1ba70a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:51.252977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:51.253863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:51.254699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:51.254699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:51.254699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:51.254699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:51.254699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:51.254699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:51.254699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:51.254699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:51.254699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:51.254699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:51.254699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:51.254699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:51.255309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 239/486] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:00:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:51.260558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ea172-e347-4869-ae8e-54537d1ba70a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:51.292246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96af9c-1460-43c2-a17d-8128e1a61790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:51.292927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96af9c-1460-43c2-a17d-8128e1a61790 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:51.293209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96af9c-1460-43c2-a17d-8128e1a61790 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:51.293485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96af9c-1460-43c2-a17d-8128e1a61790 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:51.294248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96af9c-1460-43c2-a17d-8128e1a61790 None admin] RBAC: Adding query filter params (name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:51.294559 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96af9c-1460-43c2-a17d-8128e1a61790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:51.296072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96af9c-1460-43c2-a17d-8128e1a61790 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:51.303918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:51.310629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 248/487] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:00:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:51.316657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96af9c-1460-43c2-a17d-8128e1a61790 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:51.425270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ea172-e347-4869-ae8e-54537d1ba70a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:51.454199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96af9c-1460-43c2-a17d-8128e1a61790 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:51.463426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387a0fd-6f54-4d97-9960-cb2c8f6d3f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:51.464288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a0fd-6f54-4d97-9960-cb2c8f6d3f07 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:51.464578 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a0fd-6f54-4d97-9960-cb2c8f6d3f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:51.464858 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a0fd-6f54-4d97-9960-cb2c8f6d3f07 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:51.465623 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387a0fd-6f54-4d97-9960-cb2c8f6d3f07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:51.465935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387a0fd-6f54-4d97-9960-cb2c8f6d3f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:51.467361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387a0fd-6f54-4d97-9960-cb2c8f6d3f07 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:51.476135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 240/488] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:00:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:00:51.477479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff73f01-ccf2-4256-83e6-8c733e932dd2 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:51.477770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff73f01-ccf2-4256-83e6-8c733e932dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:51.478048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff73f01-ccf2-4256-83e6-8c733e932dd2 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:51.479497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 241/489] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:51.481055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff73f01-ccf2-4256-83e6-8c733e932dd2 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:51.501812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351afcb2-3c5e-422a-8758-28090fe12234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:51.502548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351afcb2-3c5e-422a-8758-28090fe12234 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:51.502837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351afcb2-3c5e-422a-8758-28090fe12234 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:51.503137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351afcb2-3c5e-422a-8758-28090fe12234 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:51.519164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351afcb2-3c5e-422a-8758-28090fe12234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:51.520699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351afcb2-3c5e-422a-8758-28090fe12234 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:51.532229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-351afcb2-3c5e-422a-8758-28090fe12234 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:51.547914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:51.549010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:51.550063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:51.550063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:51.550063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:51.550063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:51.552374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 249/490] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:51.553895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca3efc-606d-475b-932d-e9a70033e10a None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:51.554322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca3efc-606d-475b-932d-e9a70033e10a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:51.554729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca3efc-606d-475b-932d-e9a70033e10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:51.574282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-0fca3efc-606d-475b-932d-e9a70033e10a None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:51.575648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-0fca3efc-606d-475b-932d-e9a70033e10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:51.580606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:51.618673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff73f01-ccf2-4256-83e6-8c733e932dd2 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:51.651611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 250/491] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:51.651611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca3efc-606d-475b-932d-e9a70033e10a None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:51.680427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20a9a0-ab49-4471-8fca-16b38f6c044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:51.681850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20a9a0-ab49-4471-8fca-16b38f6c044c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:51.682140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20a9a0-ab49-4471-8fca-16b38f6c044c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:51.682416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20a9a0-ab49-4471-8fca-16b38f6c044c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:51.698032 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20a9a0-ab49-4471-8fca-16b38f6c044c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:51.699469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20a9a0-ab49-4471-8fca-16b38f6c044c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ec20a9a0-ab49-4471-8fca-16b38f6c044c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:51.718249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:51.719151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:51.720071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:51.720071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:51.720071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:51.720071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:51.720071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 242/492] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:51.720768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20a9a0-ab49-4471-8fca-16b38f6c044c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:51.768977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca3efc-606d-475b-932d-e9a70033e10a None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:51.801078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:51.808768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8ff18-d7d3-4a7c-a61c-51f942f6e519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:51.809825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8ff18-d7d3-4a7c-a61c-51f942f6e519 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:51.810306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8ff18-d7d3-4a7c-a61c-51f942f6e519 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:51.810858 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8ff18-d7d3-4a7c-a61c-51f942f6e519 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:51.811838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8ff18-d7d3-4a7c-a61c-51f942f6e519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:51.812491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8ff18-d7d3-4a7c-a61c-51f942f6e519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:51.814219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8ff18-d7d3-4a7c-a61c-51f942f6e519 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:51.831351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 251/493] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:51.832663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8ff18-d7d3-4a7c-a61c-51f942f6e519 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:51.848297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20a9a0-ab49-4471-8fca-16b38f6c044c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:51.879724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:51.890738 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a91e58-4915-4da2-8339-5bff025fe783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:51.891552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a91e58-4915-4da2-8339-5bff025fe783 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:51.891859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a91e58-4915-4da2-8339-5bff025fe783 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:51.892137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a91e58-4915-4da2-8339-5bff025fe783 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:51.905655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a91e58-4915-4da2-8339-5bff025fe783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-34a91e58-4915-4da2-8339-5bff025fe783 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:51.915268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:51.916217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:51.917029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:51.917029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:51.917029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:51.917029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:51.917029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:51.917029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:51.917029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:51.917029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:51.917029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:51.917029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:51.917029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:51.917029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:51.921695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 243/494] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:00:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:51.922546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a91e58-4915-4da2-8339-5bff025fe783 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:51.953025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8ff18-d7d3-4a7c-a61c-51f942f6e519 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:51.988184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075be2b1-ba5e-4451-9174-2269676b32f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:51.989005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be2b1-ba5e-4451-9174-2269676b32f6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:51.989293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be2b1-ba5e-4451-9174-2269676b32f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:51.989714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be2b1-ba5e-4451-9174-2269676b32f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:51.990454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075be2b1-ba5e-4451-9174-2269676b32f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:51.990770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075be2b1-ba5e-4451-9174-2269676b32f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:51.992291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075be2b1-ba5e-4451-9174-2269676b32f6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:52.009959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 252/495] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:52.009959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075be2b1-ba5e-4451-9174-2269676b32f6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:52.033316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a91e58-4915-4da2-8339-5bff025fe783 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:52.062450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:52.071479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5405d-92bd-440c-be9a-9e00e69e21dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:52.072332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5405d-92bd-440c-be9a-9e00e69e21dd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.072614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5405d-92bd-440c-be9a-9e00e69e21dd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.072886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5405d-92bd-440c-be9a-9e00e69e21dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.081931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5405d-92bd-440c-be9a-9e00e69e21dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:52.083419 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5405d-92bd-440c-be9a-9e00e69e21dd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-72b5405d-92bd-440c-be9a-9e00e69e21dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:00:52.099302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:52.100449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:52.101384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:52.101384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:52.101384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:00:52.101384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:00:52.101384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:00:52.101384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:00:52.101384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:00:52.101384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:00:52.101384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:00:52.101384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:52.103327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 244/496] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 15:00:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:52.104733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8c0b5-384d-4506-bb94-b628d2c4458f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.105019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8c0b5-384d-4506-bb94-b628d2c4458f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.105297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8c0b5-384d-4506-bb94-b628d2c4458f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.106754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 245/497] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:52.107268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8c0b5-384d-4506-bb94-b628d2c4458f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:52.125730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075be2b1-ba5e-4451-9174-2269676b32f6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:52.157792 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:52.161024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f140e3e-6796-47bb-a2ec-f761d7b44dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:52.161703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f140e3e-6796-47bb-a2ec-f761d7b44dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.161982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f140e3e-6796-47bb-a2ec-f761d7b44dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.162256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f140e3e-6796-47bb-a2ec-f761d7b44dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.163012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f140e3e-6796-47bb-a2ec-f761d7b44dd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:52.163321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f140e3e-6796-47bb-a2ec-f761d7b44dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:52.164724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f140e3e-6796-47bb-a2ec-f761d7b44dd6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:52.172992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 253/498] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:00:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:52.173767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f140e3e-6796-47bb-a2ec-f761d7b44dd6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:52.220297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8c0b5-384d-4506-bb94-b628d2c4458f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:52.255628 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad34cd9-d13e-4f7b-aad8-264264f1ff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:52.256473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad34cd9-d13e-4f7b-aad8-264264f1ff1c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.256753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad34cd9-d13e-4f7b-aad8-264264f1ff1c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.257023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad34cd9-d13e-4f7b-aad8-264264f1ff1c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.264770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad34cd9-d13e-4f7b-aad8-264264f1ff1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:52.266219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad34cd9-d13e-4f7b-aad8-264264f1ff1c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:52.276676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f140e3e-6796-47bb-a2ec-f761d7b44dd6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-0ad34cd9-d13e-4f7b-aad8-264264f1ff1c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:00:52.280571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:52.281632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 246/499] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29871f4d-238d-49de-b132-678052e46095 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.287318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29871f4d-238d-49de-b132-678052e46095 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.288203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29871f4d-238d-49de-b132-678052e46095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.290094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:52.300607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-29871f4d-238d-49de-b132-678052e46095 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:52.301812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-29871f4d-238d-49de-b132-678052e46095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:52.311049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdefda6-9fd3-4268-b222-7cd674e83eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:52.311821 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdefda6-9fd3-4268-b222-7cd674e83eec None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.312104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdefda6-9fd3-4268-b222-7cd674e83eec None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.312375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdefda6-9fd3-4268-b222-7cd674e83eec None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.313221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdefda6-9fd3-4268-b222-7cd674e83eec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:52.313523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdefda6-9fd3-4268-b222-7cd674e83eec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:52.314962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdefda6-9fd3-4268-b222-7cd674e83eec None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:52.351321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 254/500] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 15:00:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:52.352276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdefda6-9fd3-4268-b222-7cd674e83eec None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:52.367440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 247/501] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:52.369070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36638d7d-f030-4a05-9bf4-168e82fd7ea2 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.369361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36638d7d-f030-4a05-9bf4-168e82fd7ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.369636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36638d7d-f030-4a05-9bf4-168e82fd7ea2 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.370896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 248/502] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:52.371586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36638d7d-f030-4a05-9bf4-168e82fd7ea2 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:52.409244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:52.463397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdefda6-9fd3-4268-b222-7cd674e83eec None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:52.472828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36638d7d-f030-4a05-9bf4-168e82fd7ea2 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:52.496930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549de387-f6a3-4314-a16f-88e9d6fa4390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:52.497723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549de387-f6a3-4314-a16f-88e9d6fa4390 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.497997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549de387-f6a3-4314-a16f-88e9d6fa4390 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.498271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549de387-f6a3-4314-a16f-88e9d6fa4390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.506465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c897b8-880a-49bc-a076-237d1d857679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:52.507165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c897b8-880a-49bc-a076-237d1d857679 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.507448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c897b8-880a-49bc-a076-237d1d857679 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.507757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c897b8-880a-49bc-a076-237d1d857679 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.508040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549de387-f6a3-4314-a16f-88e9d6fa4390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:52.508602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c897b8-880a-49bc-a076-237d1d857679 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:52.508911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c897b8-880a-49bc-a076-237d1d857679 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:52.509506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549de387-f6a3-4314-a16f-88e9d6fa4390 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:52.510317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c897b8-880a-49bc-a076-237d1d857679 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-549de387-f6a3-4314-a16f-88e9d6fa4390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:52.526767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:52.528041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:52.528896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:52.528896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:52.528896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:52.528896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:52.528896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 255/503] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:52.528896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549de387-f6a3-4314-a16f-88e9d6fa4390 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:52.547059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 249/504] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 15:00:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:52.548279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11a276-a14b-47d9-8702-fef05c491301 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.548569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11a276-a14b-47d9-8702-fef05c491301 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.548833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11a276-a14b-47d9-8702-fef05c491301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.557970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:52.564741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-de11a276-a14b-47d9-8702-fef05c491301 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:52.565940 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-de11a276-a14b-47d9-8702-fef05c491301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:52.630131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 250/505] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:52.630952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11a276-a14b-47d9-8702-fef05c491301 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:52.631736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549de387-f6a3-4314-a16f-88e9d6fa4390 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:52.662572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:52.666473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e3fa6-d0a9-48a6-bec0-5eebe2a55e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:52.667139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e3fa6-d0a9-48a6-bec0-5eebe2a55e9f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.667421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e3fa6-d0a9-48a6-bec0-5eebe2a55e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.667739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e3fa6-d0a9-48a6-bec0-5eebe2a55e9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.733721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e3fa6-d0a9-48a6-bec0-5eebe2a55e9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:52.734603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11a276-a14b-47d9-8702-fef05c491301 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:52.735181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e3fa6-d0a9-48a6-bec0-5eebe2a55e9f None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:52.757523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:52.768044 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b71751-e668-4fbd-bd39-9b01411b3e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:52.768852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b71751-e668-4fbd-bd39-9b01411b3e6b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.769129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b71751-e668-4fbd-bd39-9b01411b3e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.769397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b71751-e668-4fbd-bd39-9b01411b3e6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.779453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b71751-e668-4fbd-bd39-9b01411b3e6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-f6b71751-e668-4fbd-bd39-9b01411b3e6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:52.787304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:52.788381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:52.789173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 251/506] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:00:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:52.790101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b71751-e668-4fbd-bd39-9b01411b3e6b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:52.833464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 256/507] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:52.834230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e3fa6-d0a9-48a6-bec0-5eebe2a55e9f None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:52.878066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:52.893349 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b71751-e668-4fbd-bd39-9b01411b3e6b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:52.926724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba69d4-d427-4915-83b2-621c07cc528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:52.927542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba69d4-d427-4915-83b2-621c07cc528b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.927852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba69d4-d427-4915-83b2-621c07cc528b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.928124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba69d4-d427-4915-83b2-621c07cc528b None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:52.928863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba69d4-d427-4915-83b2-621c07cc528b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:52.929170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba69d4-d427-4915-83b2-621c07cc528b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:52.930560 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba69d4-d427-4915-83b2-621c07cc528b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:52.940219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e3fa6-d0a9-48a6-bec0-5eebe2a55e9f None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:52.941857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 252/508] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:52.942726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba69d4-d427-4915-83b2-621c07cc528b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:52.976659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:52.992917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24f5e7-4593-4b04-ae10-952364c47832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:52.993932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24f5e7-4593-4b04-ae10-952364c47832 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:52.994388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24f5e7-4593-4b04-ae10-952364c47832 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:52.994832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24f5e7-4593-4b04-ae10-952364c47832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.081956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba69d4-d427-4915-83b2-621c07cc528b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:53.086520 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24f5e7-4593-4b04-ae10-952364c47832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:53.087971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24f5e7-4593-4b04-ae10-952364c47832 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:53.116372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430088a6-cff8-4ee4-bc28-ed74309867ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:53.117167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430088a6-cff8-4ee4-bc28-ed74309867ec None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.117422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430088a6-cff8-4ee4-bc28-ed74309867ec None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.117722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430088a6-cff8-4ee4-bc28-ed74309867ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.127721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430088a6-cff8-4ee4-bc28-ed74309867ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:53.129146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430088a6-cff8-4ee4-bc28-ed74309867ec None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:53.131688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-430088a6-cff8-4ee4-bc28-ed74309867ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:53.147535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:53.148492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:53.149585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:53.149585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:53.149585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:53.149585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:53.149585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 253/509] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:53.149585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430088a6-cff8-4ee4-bc28-ed74309867ec None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:53.188593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 257/510] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:53.189425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24f5e7-4593-4b04-ae10-952364c47832 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:53.212318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:53.246793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430088a6-cff8-4ee4-bc28-ed74309867ec None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:53.280160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e41235-e4da-43a5-8a44-4e8f263dd92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:53.280847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e41235-e4da-43a5-8a44-4e8f263dd92f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.281129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e41235-e4da-43a5-8a44-4e8f263dd92f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.281404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e41235-e4da-43a5-8a44-4e8f263dd92f None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.282152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e41235-e4da-43a5-8a44-4e8f263dd92f None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:53.282463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e41235-e4da-43a5-8a44-4e8f263dd92f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:53.283853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e41235-e4da-43a5-8a44-4e8f263dd92f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:53.287975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24f5e7-4593-4b04-ae10-952364c47832 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:53.291474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 254/511] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:00:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:53.292276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e41235-e4da-43a5-8a44-4e8f263dd92f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:53.322132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487141c-b2ec-49ec-8a8d-3fce60641721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:53.322927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487141c-b2ec-49ec-8a8d-3fce60641721 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.323208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487141c-b2ec-49ec-8a8d-3fce60641721 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.323483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487141c-b2ec-49ec-8a8d-3fce60641721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.333662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487141c-b2ec-49ec-8a8d-3fce60641721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:53.335115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487141c-b2ec-49ec-8a8d-3fce60641721 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:53.349926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-9487141c-b2ec-49ec-8a8d-3fce60641721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:53.357553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:53.358471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:53.359375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:53.359375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:53.359375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:53.359375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:53.359375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 258/512] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:53.359661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487141c-b2ec-49ec-8a8d-3fce60641721 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:53.393215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e41235-e4da-43a5-8a44-4e8f263dd92f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:53.427657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889de638-dd28-40b1-a5b1-650a237e6bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:53.428461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889de638-dd28-40b1-a5b1-650a237e6bfd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.428744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889de638-dd28-40b1-a5b1-650a237e6bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.429043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889de638-dd28-40b1-a5b1-650a237e6bfd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.434704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:53.437600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889de638-dd28-40b1-a5b1-650a237e6bfd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:53.439092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889de638-dd28-40b1-a5b1-650a237e6bfd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-889de638-dd28-40b1-a5b1-650a237e6bfd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:00:53.453802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:53.454817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:53.455776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:53.455776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:53.455776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:00:53.455776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:00:53.455776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:00:53.455776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:00:53.455776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:00:53.455776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:00:53.455776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:00:53.455776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:53.455776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 255/513] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:53.456333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889de638-dd28-40b1-a5b1-650a237e6bfd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:53.465462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487141c-b2ec-49ec-8a8d-3fce60641721 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:53.500116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61a07c-b5e8-40d1-9749-e64fe29c71eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:53.500817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61a07c-b5e8-40d1-9749-e64fe29c71eb None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.501104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61a07c-b5e8-40d1-9749-e64fe29c71eb None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.501380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61a07c-b5e8-40d1-9749-e64fe29c71eb None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.502115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61a07c-b5e8-40d1-9749-e64fe29c71eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:53.502423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61a07c-b5e8-40d1-9749-e64fe29c71eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:53.503836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61a07c-b5e8-40d1-9749-e64fe29c71eb None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:53.515136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 259/514] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:53.515935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61a07c-b5e8-40d1-9749-e64fe29c71eb None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:53.561153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889de638-dd28-40b1-a5b1-650a237e6bfd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:53.578135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:53.595159 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801f489-0512-48ff-9c8b-e8872611611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:53.595994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801f489-0512-48ff-9c8b-e8872611611a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.596285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801f489-0512-48ff-9c8b-e8872611611a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.596568 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801f489-0512-48ff-9c8b-e8872611611a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.606867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801f489-0512-48ff-9c8b-e8872611611a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:53.608288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801f489-0512-48ff-9c8b-e8872611611a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:53.613350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61a07c-b5e8-40d1-9749-e64fe29c71eb None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-d801f489-0512-48ff-9c8b-e8872611611a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:53.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:53.626115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:53.627164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:53.627164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:53.627164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:53.627164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:53.627164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 256/515] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:53.627550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801f489-0512-48ff-9c8b-e8872611611a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:53.649416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cab4ab-c9e7-43c7-95e1-c13bab49d0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:53.650218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cab4ab-c9e7-43c7-95e1-c13bab49d0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.650506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cab4ab-c9e7-43c7-95e1-c13bab49d0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.650787 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cab4ab-c9e7-43c7-95e1-c13bab49d0b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.652649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:53.661756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cab4ab-c9e7-43c7-95e1-c13bab49d0b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:53.663218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cab4ab-c9e7-43c7-95e1-c13bab49d0b1 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-47cab4ab-c9e7-43c7-95e1-c13bab49d0b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:53.680632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:53.681524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:53.682368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:53.682368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:53.682368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:53.682368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:53.682368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 260/516] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:53.682643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cab4ab-c9e7-43c7-95e1-c13bab49d0b1 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:53.731274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801f489-0512-48ff-9c8b-e8872611611a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:53.764055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc60fe8-6f29-4923-ad20-c94d6764af2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:53.764721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc60fe8-6f29-4923-ad20-c94d6764af2f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.765061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc60fe8-6f29-4923-ad20-c94d6764af2f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.765333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc60fe8-6f29-4923-ad20-c94d6764af2f None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.766063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc60fe8-6f29-4923-ad20-c94d6764af2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:53.766370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc60fe8-6f29-4923-ad20-c94d6764af2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:53.767761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc60fe8-6f29-4923-ad20-c94d6764af2f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:53.779515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 257/517] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:53.780297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc60fe8-6f29-4923-ad20-c94d6764af2f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:53.790437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cab4ab-c9e7-43c7-95e1-c13bab49d0b1 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:53.809190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:53.824086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e8c1f-0779-4405-86b1-1450d697fcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:53.824767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e8c1f-0779-4405-86b1-1450d697fcac None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.825057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e8c1f-0779-4405-86b1-1450d697fcac None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.825338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e8c1f-0779-4405-86b1-1450d697fcac None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.826195 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e8c1f-0779-4405-86b1-1450d697fcac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:53.826509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e8c1f-0779-4405-86b1-1450d697fcac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:53.828086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e8c1f-0779-4405-86b1-1450d697fcac None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:53.845350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 261/518] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 15:00:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:53.848593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e8c1f-0779-4405-86b1-1450d697fcac None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:53.877394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc60fe8-6f29-4923-ad20-c94d6764af2f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:53.894572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:53.911421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee4431-f62e-43ae-a7b0-36defeabcc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:53.912126 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee4431-f62e-43ae-a7b0-36defeabcc9f None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:53.912409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee4431-f62e-43ae-a7b0-36defeabcc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:53.912675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee4431-f62e-43ae-a7b0-36defeabcc9f None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:53.913383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee4431-f62e-43ae-a7b0-36defeabcc9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:53.914811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee4431-f62e-43ae-a7b0-36defeabcc9f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:53.934709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 258/519] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:00:53 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:00:53.935600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee4431-f62e-43ae-a7b0-36defeabcc9f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:53.957552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e8c1f-0779-4405-86b1-1450d697fcac None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:54.000084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611f371-cf91-4e1a-af5d-522dc8458727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:54.000867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611f371-cf91-4e1a-af5d-522dc8458727 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:54.001157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611f371-cf91-4e1a-af5d-522dc8458727 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:54.001437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611f371-cf91-4e1a-af5d-522dc8458727 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:54.002360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611f371-cf91-4e1a-af5d-522dc8458727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:54.002831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611f371-cf91-4e1a-af5d-522dc8458727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:54.004333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611f371-cf91-4e1a-af5d-522dc8458727 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:54.017772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 262/520] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:54.018650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611f371-cf91-4e1a-af5d-522dc8458727 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:54.040193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:54.058945 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee4431-f62e-43ae-a7b0-36defeabcc9f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:54.094863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586b401-c890-4a98-a2fb-f9fb140743f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:54.095586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b401-c890-4a98-a2fb-f9fb140743f9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:54.095870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b401-c890-4a98-a2fb-f9fb140743f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:54.096149 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b401-c890-4a98-a2fb-f9fb140743f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:54.096899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586b401-c890-4a98-a2fb-f9fb140743f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:54.097209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586b401-c890-4a98-a2fb-f9fb140743f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:54.098620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586b401-c890-4a98-a2fb-f9fb140743f9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:54.113013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 259/521] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:54.118156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586b401-c890-4a98-a2fb-f9fb140743f9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:54.135835 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611f371-cf91-4e1a-af5d-522dc8458727 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:54.138358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:54.176147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9950b-f648-46f8-8bc6-4cb37f45d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:54.177079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9950b-f648-46f8-8bc6-4cb37f45d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:54.177362 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9950b-f648-46f8-8bc6-4cb37f45d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:54.177636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9950b-f648-46f8-8bc6-4cb37f45d2f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:54.188998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9950b-f648-46f8-8bc6-4cb37f45d2f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:54.190499 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9950b-f648-46f8-8bc6-4cb37f45d2f3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-78b9950b-f648-46f8-8bc6-4cb37f45d2f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:00:54.205496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:54.206383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:54.207250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:00:54.207250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:00:54.207250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:00:54.207250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:00:54.207250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:00:54.207250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:00:54.207250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:00:54.207250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:54.207250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 263/522] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:54.208464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9950b-f648-46f8-8bc6-4cb37f45d2f3 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:54.233553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586b401-c890-4a98-a2fb-f9fb140743f9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:54.272198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f817d-6173-4e5c-8263-efbef6817223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:54.272890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f817d-6173-4e5c-8263-efbef6817223 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:54.273176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f817d-6173-4e5c-8263-efbef6817223 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:54.273533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f817d-6173-4e5c-8263-efbef6817223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:54.290368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:54.324323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9950b-f648-46f8-8bc6-4cb37f45d2f3 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:54.344193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f817d-6173-4e5c-8263-efbef6817223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:54.345658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f817d-6173-4e5c-8263-efbef6817223 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:54.368741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf02bc5-e03a-4cdd-a6af-a91b364aa9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:54.369565 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf02bc5-e03a-4cdd-a6af-a91b364aa9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:54.369834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf02bc5-e03a-4cdd-a6af-a91b364aa9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:54.370112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf02bc5-e03a-4cdd-a6af-a91b364aa9a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:54.378112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf02bc5-e03a-4cdd-a6af-a91b364aa9a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:54.379578 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf02bc5-e03a-4cdd-a6af-a91b364aa9a6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-ccf02bc5-e03a-4cdd-a6af-a91b364aa9a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:00:54.393920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:54.394767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:54.395996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:00:54.395996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:00:54.395996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:00:54.395996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:00:54.395996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:00:54.395996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:00:54.395996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:00:54.395996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:54.395996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 264/523] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:54.396551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf02bc5-e03a-4cdd-a6af-a91b364aa9a6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:54.426816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:54.463026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 260/524] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:54.463026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f817d-6173-4e5c-8263-efbef6817223 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:54.508811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:54.516906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf02bc5-e03a-4cdd-a6af-a91b364aa9a6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:54.552430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83228235-aafe-4007-acf7-fbe4529b05b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:54.553483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83228235-aafe-4007-acf7-fbe4529b05b9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:54.553951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83228235-aafe-4007-acf7-fbe4529b05b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:54.554235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83228235-aafe-4007-acf7-fbe4529b05b9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:54.562330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83228235-aafe-4007-acf7-fbe4529b05b9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:54.563804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83228235-aafe-4007-acf7-fbe4529b05b9 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:54.569961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f817d-6173-4e5c-8263-efbef6817223 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-83228235-aafe-4007-acf7-fbe4529b05b9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:00:54.580486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:54.581817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:54.582717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:54.582717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:54.582717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:00:54.582717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:00:54.582717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:00:54.582717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:00:54.582717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:00:54.582717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:00:54.582717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:00:54.582717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:54.582717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 265/525] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:00:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:54.582717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83228235-aafe-4007-acf7-fbe4529b05b9 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:54.612977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c87fb-5c21-4a0a-bb77-37a0f94c6aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:54.613652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c87fb-5c21-4a0a-bb77-37a0f94c6aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:54.613939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c87fb-5c21-4a0a-bb77-37a0f94c6aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:54.614215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c87fb-5c21-4a0a-bb77-37a0f94c6aa4 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:54.615080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c87fb-5c21-4a0a-bb77-37a0f94c6aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:54.615462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c87fb-5c21-4a0a-bb77-37a0f94c6aa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:54.616879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c87fb-5c21-4a0a-bb77-37a0f94c6aa4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:54.639813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 261/526] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:54.639813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c87fb-5c21-4a0a-bb77-37a0f94c6aa4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:54.674381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:54.692416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83228235-aafe-4007-acf7-fbe4529b05b9 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:54.729539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b47a0-ad3c-4870-ba82-6b7b384b1161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:54.730223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b47a0-ad3c-4870-ba82-6b7b384b1161 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:54.730511 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b47a0-ad3c-4870-ba82-6b7b384b1161 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:54.730816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b47a0-ad3c-4870-ba82-6b7b384b1161 None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:54.731635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b47a0-ad3c-4870-ba82-6b7b384b1161 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:54.731952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b47a0-ad3c-4870-ba82-6b7b384b1161 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:54.733419 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b47a0-ad3c-4870-ba82-6b7b384b1161 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:54.741493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c87fb-5c21-4a0a-bb77-37a0f94c6aa4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:54.749636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:54.752070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 266/527] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:54.752722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b47a0-ad3c-4870-ba82-6b7b384b1161 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:54.782596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa8635-b090-4f92-8337-6eadc1865cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:54.783397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa8635-b090-4f92-8337-6eadc1865cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:54.783711 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa8635-b090-4f92-8337-6eadc1865cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:54.783985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa8635-b090-4f92-8337-6eadc1865cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:54.793988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa8635-b090-4f92-8337-6eadc1865cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:54.795441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa8635-b090-4f92-8337-6eadc1865cc6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-43fa8635-b090-4f92-8337-6eadc1865cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:54.815910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:54.816834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:54.817702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:54.817702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:54.817702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:54.817702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:54.819413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 262/528] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:54.820343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa8635-b090-4f92-8337-6eadc1865cc6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:54.863297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b47a0-ad3c-4870-ba82-6b7b384b1161 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:54.902192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd6672-e0bb-464e-b482-5fe12640c417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:54.902933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd6672-e0bb-464e-b482-5fe12640c417 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:54.903328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd6672-e0bb-464e-b482-5fe12640c417 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:54.903624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd6672-e0bb-464e-b482-5fe12640c417 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:54.904468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd6672-e0bb-464e-b482-5fe12640c417 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:54.904776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd6672-e0bb-464e-b482-5fe12640c417 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:54.906428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd6672-e0bb-464e-b482-5fe12640c417 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:54.924002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa8635-b090-4f92-8337-6eadc1865cc6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:54.927861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 267/529] 10.222.0.24 () {56 vars in 1139 bytes} [Wed May 25 15:00:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:54.928865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd6672-e0bb-464e-b482-5fe12640c417 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:54.934727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:54.962796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b152744-fcd6-4d9c-8946-4d68db8e410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:54.963741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b152744-fcd6-4d9c-8946-4d68db8e410e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:54.964029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b152744-fcd6-4d9c-8946-4d68db8e410e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:54.964307 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b152744-fcd6-4d9c-8946-4d68db8e410e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:54.965152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b152744-fcd6-4d9c-8946-4d68db8e410e None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=f553cee02ab345dabbef807bfe85544a) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:54.965472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b152744-fcd6-4d9c-8946-4d68db8e410e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:54.966945 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b152744-fcd6-4d9c-8946-4d68db8e410e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:54.972633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 263/530] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:54 2022] GET /identity/v3/role_assignments?user.id=f553cee02ab345dabbef807bfe85544a&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:54.973229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b152744-fcd6-4d9c-8946-4d68db8e410e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:55.005720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:55.050129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd6672-e0bb-464e-b482-5fe12640c417 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:55.095731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b388-1111-4520-94c4-c8f811632d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:55.097511 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b388-1111-4520-94c4-c8f811632d37 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:55.098000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b388-1111-4520-94c4-c8f811632d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:55.098460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b388-1111-4520-94c4-c8f811632d37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:55.100430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b388-1111-4520-94c4-c8f811632d37 None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=79f0aa2ddbcb494f8a5a53399793aa2e) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:55.101262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b388-1111-4520-94c4-c8f811632d37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:55.103956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b388-1111-4520-94c4-c8f811632d37 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:55.106660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b152744-fcd6-4d9c-8946-4d68db8e410e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:55.112858 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 268/531] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:54 2022] GET /identity/v3/role_assignments?user.id=79f0aa2ddbcb494f8a5a53399793aa2e&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:55.113976 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b388-1111-4520-94c4-c8f811632d37 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:55.199601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:55.203224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b783b5-d5ac-4601-ad52-e819a7be958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:55.203943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b783b5-d5ac-4601-ad52-e819a7be958f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:55.204225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b783b5-d5ac-4601-ad52-e819a7be958f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:55.204496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b783b5-d5ac-4601-ad52-e819a7be958f None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:55.205231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b783b5-d5ac-4601-ad52-e819a7be958f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:55.205533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b783b5-d5ac-4601-ad52-e819a7be958f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:55.206943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b783b5-d5ac-4601-ad52-e819a7be958f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:55.239261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 264/532] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:55.243513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b388-1111-4520-94c4-c8f811632d37 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:55.244638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b783b5-d5ac-4601-ad52-e819a7be958f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:55.329414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b64773-fd41-4d03-ba5a-d056eacd7879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:55.330104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b64773-fd41-4d03-ba5a-d056eacd7879 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:55.330391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b64773-fd41-4d03-ba5a-d056eacd7879 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:55.330670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b64773-fd41-4d03-ba5a-d056eacd7879 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:55.371797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:55.393800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b783b5-d5ac-4601-ad52-e819a7be958f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:55.429496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825bb7-c24e-47c6-a95c-2c8982ee2560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:55.430610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825bb7-c24e-47c6-a95c-2c8982ee2560 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:55.431196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825bb7-c24e-47c6-a95c-2c8982ee2560 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:55.431673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825bb7-c24e-47c6-a95c-2c8982ee2560 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:55.439845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825bb7-c24e-47c6-a95c-2c8982ee2560 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:55.441594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825bb7-c24e-47c6-a95c-2c8982ee2560 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9d825bb7-c24e-47c6-a95c-2c8982ee2560 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:00:55.458410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:55.459290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:55.460163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:00:55.460163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:00:55.460163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:00:55.460163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:00:55.460163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:00:55.460163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:00:55.460163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:00:55.460163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:55.462389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 265/533] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:55.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825bb7-c24e-47c6-a95c-2c8982ee2560 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:55.524434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b64773-fd41-4d03-ba5a-d056eacd7879 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:55.526200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b64773-fd41-4d03-ba5a-d056eacd7879 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:55.581052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825bb7-c24e-47c6-a95c-2c8982ee2560 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:55.619814 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f9b2f-df51-4b3d-b67d-e6e1548a3149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:55.620764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f9b2f-df51-4b3d-b67d-e6e1548a3149 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:55.621194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f9b2f-df51-4b3d-b67d-e6e1548a3149 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:55.621611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f9b2f-df51-4b3d-b67d-e6e1548a3149 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:55.623112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f9b2f-df51-4b3d-b67d-e6e1548a3149 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:55.623660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f9b2f-df51-4b3d-b67d-e6e1548a3149 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:55.625279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f9b2f-df51-4b3d-b67d-e6e1548a3149 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:55.639641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 266/534] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:00:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:55.646197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f9b2f-df51-4b3d-b67d-e6e1548a3149 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:55.653532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:55.676516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:55.739329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 269/535] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:55.744489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b64773-fd41-4d03-ba5a-d056eacd7879 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:55.762242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f9b2f-df51-4b3d-b67d-e6e1548a3149 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:55.844985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeaef9-78aa-4248-b033-64af79045ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:55.845667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeaef9-78aa-4248-b033-64af79045ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:55.845950 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeaef9-78aa-4248-b033-64af79045ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:55.846227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeaef9-78aa-4248-b033-64af79045ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:55.847079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeaef9-78aa-4248-b033-64af79045ab3 None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=49e5814865044696a7d0021d44629604) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:55.847394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeaef9-78aa-4248-b033-64af79045ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:55.848885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeaef9-78aa-4248-b033-64af79045ab3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:55.868891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b64773-fd41-4d03-ba5a-d056eacd7879 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:55.869471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 267/536] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:55 2022] GET /identity/v3/role_assignments?user.id=49e5814865044696a7d0021d44629604&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:55.932189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2e915-06cb-440d-9bf3-1bd895e764ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:55.933303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2e915-06cb-440d-9bf3-1bd895e764ad None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:55.933758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2e915-06cb-440d-9bf3-1bd895e764ad None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:55.934240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2e915-06cb-440d-9bf3-1bd895e764ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:55.945132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2e915-06cb-440d-9bf3-1bd895e764ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:55.946896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2e915-06cb-440d-9bf3-1bd895e764ad None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-69c2e915-06cb-440d-9bf3-1bd895e764ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:55.966062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:55.967081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:55.967953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:55.967953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:55.967953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:55.967953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:55.970070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 270/537] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:55.975618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeaef9-78aa-4248-b033-64af79045ab3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:56.088804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:56.135518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeaef9-78aa-4248-b033-64af79045ab3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:56.171676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78a435-8cd3-439a-9f10-0aa1ca26f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:56.172352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a435-8cd3-439a-9f10-0aa1ca26f233 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:56.172708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a435-8cd3-439a-9f10-0aa1ca26f233 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:56.172962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a435-8cd3-439a-9f10-0aa1ca26f233 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:56.173692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78a435-8cd3-439a-9f10-0aa1ca26f233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:56.173997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78a435-8cd3-439a-9f10-0aa1ca26f233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:56.175374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78a435-8cd3-439a-9f10-0aa1ca26f233 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:56.188811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 268/538] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:56.193896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2e915-06cb-440d-9bf3-1bd895e764ad None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:56.213569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:56.320986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2e915-06cb-440d-9bf3-1bd895e764ad None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:56.368688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e908df-a6a9-4703-b264-92fff5621e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:56.369501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e908df-a6a9-4703-b264-92fff5621e71 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:56.369842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e908df-a6a9-4703-b264-92fff5621e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:56.370176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e908df-a6a9-4703-b264-92fff5621e71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:56.383107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e908df-a6a9-4703-b264-92fff5621e71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:56.384703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e908df-a6a9-4703-b264-92fff5621e71 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-a9e908df-a6a9-4703-b264-92fff5621e71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:00:56.402241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:56.403325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:56.404413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:00:56.404413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:00:56.404413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:00:56.404413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:00:56.404413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:00:56.404413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:00:56.404413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:00:56.404413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:56.406042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 271/539] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:56.416899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78a435-8cd3-439a-9f10-0aa1ca26f233 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:56.544990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78a435-8cd3-439a-9f10-0aa1ca26f233 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:56.571057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:56.590915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cef87-9b88-44b1-8fc8-6dc8265adde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:56.591601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cef87-9b88-44b1-8fc8-6dc8265adde3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:56.591890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cef87-9b88-44b1-8fc8-6dc8265adde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:56.592165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cef87-9b88-44b1-8fc8-6dc8265adde3 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:56.592976 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cef87-9b88-44b1-8fc8-6dc8265adde3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:56.593282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cef87-9b88-44b1-8fc8-6dc8265adde3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:56.594935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cef87-9b88-44b1-8fc8-6dc8265adde3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:56.611821 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 269/540] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:00:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:56.617619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e908df-a6a9-4703-b264-92fff5621e71 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:56.704539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034b229-3b68-4a0c-81a2-9f5a08984f4a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:56.704727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034b229-3b68-4a0c-81a2-9f5a08984f4a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:56.705002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034b229-3b68-4a0c-81a2-9f5a08984f4a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:56.706499 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 270/541] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:56.712956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60f9e1-1f52-4ce2-b2fd-9fd57807297e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:56.713246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60f9e1-1f52-4ce2-b2fd-9fd57807297e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:56.713528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60f9e1-1f52-4ce2-b2fd-9fd57807297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:56.723305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:56.739161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ca60f9e1-1f52-4ce2-b2fd-9fd57807297e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:56.740742 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ca60f9e1-1f52-4ce2-b2fd-9fd57807297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:56.747438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e908df-a6a9-4703-b264-92fff5621e71 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:56.786399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d3fe1-5e2c-48e0-84ef-ce7bf0a73551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:56.787068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d3fe1-5e2c-48e0-84ef-ce7bf0a73551 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:56.787351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d3fe1-5e2c-48e0-84ef-ce7bf0a73551 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:56.787654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d3fe1-5e2c-48e0-84ef-ce7bf0a73551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:56.789168 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d3fe1-5e2c-48e0-84ef-ce7bf0a73551 None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=d4b24eb13be7443f9c24e55532ef95d3) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:56.789484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d3fe1-5e2c-48e0-84ef-ce7bf0a73551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:56.791077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d3fe1-5e2c-48e0-84ef-ce7bf0a73551 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:56.803937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 272/542] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:00:56 2022] GET /identity/v3/role_assignments?user.id=d4b24eb13be7443f9c24e55532ef95d3&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:56.878129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 271/543] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:56.917806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d3fe1-5e2c-48e0-84ef-ce7bf0a73551 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:57.050541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d3fe1-5e2c-48e0-84ef-ce7bf0a73551 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:57.100860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859de9b-ec43-472f-9adf-875f089ac233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:57.101697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859de9b-ec43-472f-9adf-875f089ac233 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:57.101983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859de9b-ec43-472f-9adf-875f089ac233 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:57.102262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859de9b-ec43-472f-9adf-875f089ac233 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:57.117217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859de9b-ec43-472f-9adf-875f089ac233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-5859de9b-ec43-472f-9adf-875f089ac233 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:57.125101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:57.125983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:57.127188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 273/544] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:00:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:57.132518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60f9e1-1f52-4ce2-b2fd-9fd57807297e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:57.278924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60f9e1-1f52-4ce2-b2fd-9fd57807297e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:57.303420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:57.329574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1c8c1-670e-49f5-8f24-83a8aab81ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:57.330260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1c8c1-670e-49f5-8f24-83a8aab81ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:57.330549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1c8c1-670e-49f5-8f24-83a8aab81ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:57.330830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1c8c1-670e-49f5-8f24-83a8aab81ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:57.331618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1c8c1-670e-49f5-8f24-83a8aab81ae3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:57.331922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1c8c1-670e-49f5-8f24-83a8aab81ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:57.333301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1c8c1-670e-49f5-8f24-83a8aab81ae3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:57.347940 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 272/545] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:00:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:57.355212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859de9b-ec43-472f-9adf-875f089ac233 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:57.362125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:57.490848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859de9b-ec43-472f-9adf-875f089ac233 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:57.511733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439daa2-8061-42c8-8995-4279a7666954 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:57.512055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439daa2-8061-42c8-8995-4279a7666954 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:57.512310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439daa2-8061-42c8-8995-4279a7666954 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:57.513689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 273/546] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:57.519107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb7f6d-e3dc-4983-8d2b-f56b1d5aa06d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:57.519404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb7f6d-e3dc-4983-8d2b-f56b1d5aa06d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:57.519717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb7f6d-e3dc-4983-8d2b-f56b1d5aa06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:57.527230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753ffe1-0933-4466-a7d4-39bbf216ff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:57.528359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753ffe1-0933-4466-a7d4-39bbf216ff30 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:57.528839 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753ffe1-0933-4466-a7d4-39bbf216ff30 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:57.529339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753ffe1-0933-4466-a7d4-39bbf216ff30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:57.540591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753ffe1-0933-4466-a7d4-39bbf216ff30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:57.542337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753ffe1-0933-4466-a7d4-39bbf216ff30 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:57.552676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-31bb7f6d-e3dc-4983-8d2b-f56b1d5aa06d None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:57.553952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-31bb7f6d-e3dc-4983-8d2b-f56b1d5aa06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-0753ffe1-0933-4466-a7d4-39bbf216ff30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:57.560616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:57.561484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:57.562426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:57.562426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:57.562426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:57.562426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:57.564747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 274/547] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:57.570329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753ffe1-0933-4466-a7d4-39bbf216ff30 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:57.662144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 274/548] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:57.699935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:57.700485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb7f6d-e3dc-4983-8d2b-f56b1d5aa06d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:57.752274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753ffe1-0933-4466-a7d4-39bbf216ff30 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:57.816365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c9f47-73e2-4092-9544-0427cbb657f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:57.817414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c9f47-73e2-4092-9544-0427cbb657f5 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:57.817911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c9f47-73e2-4092-9544-0427cbb657f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:57.818383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c9f47-73e2-4092-9544-0427cbb657f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:57.819339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c9f47-73e2-4092-9544-0427cbb657f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:57.820068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c9f47-73e2-4092-9544-0427cbb657f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:57.824028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c9f47-73e2-4092-9544-0427cbb657f5 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:57.837687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 275/549] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:57.843271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c9f47-73e2-4092-9544-0427cbb657f5 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:57.888401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb7f6d-e3dc-4983-8d2b-f56b1d5aa06d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:57.909046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:57.964269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e93d0-fce7-4d17-88fc-ee60f59cfb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:57.965095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e93d0-fce7-4d17-88fc-ee60f59cfb87 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:57.965377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e93d0-fce7-4d17-88fc-ee60f59cfb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:57.965650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e93d0-fce7-4d17-88fc-ee60f59cfb87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:57.989240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e93d0-fce7-4d17-88fc-ee60f59cfb87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:57.996423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c9f47-73e2-4092-9544-0427cbb657f5 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a45e93d0-fce7-4d17-88fc-ee60f59cfb87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:57.997443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:57.998862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:58.000236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 275/550] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:00:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:58.000932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c4d4-9f36-4d7f-a46f-f665e1d1d5bf None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:58.000932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c4d4-9f36-4d7f-a46f-f665e1d1d5bf None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:58.000932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c4d4-9f36-4d7f-a46f-f665e1d1d5bf None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:58.006813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 276/551] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:58.007668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0c4d4-9f36-4d7f-a46f-f665e1d1d5bf None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:58.018463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:58.045388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29653664-c8d8-40a9-84fc-1b7075d2d964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:58.046340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29653664-c8d8-40a9-84fc-1b7075d2d964 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:58.046726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29653664-c8d8-40a9-84fc-1b7075d2d964 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:58.047101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29653664-c8d8-40a9-84fc-1b7075d2d964 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:58.056487 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29653664-c8d8-40a9-84fc-1b7075d2d964 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:58.058698 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29653664-c8d8-40a9-84fc-1b7075d2d964 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-29653664-c8d8-40a9-84fc-1b7075d2d964 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:00:58.076679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:58.077822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:58.078964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:58.078964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:58.078964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:00:58.078964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:00:58.078964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:00:58.078964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:00:58.078964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:00:58.078964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:00:58.078964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 15:00:58.078964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:58.083640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 276/552] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:00:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:58.085136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c2e2d-6800-488b-91a5-a49d37ee2a65 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:58.085621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c2e2d-6800-488b-91a5-a49d37ee2a65 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:58.086109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c2e2d-6800-488b-91a5-a49d37ee2a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:58.104378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-762c2e2d-6800-488b-91a5-a49d37ee2a65 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:58.106013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-762c2e2d-6800-488b-91a5-a49d37ee2a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:58.140678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0c4d4-9f36-4d7f-a46f-f665e1d1d5bf None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:58.177748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b33b18-9204-4dbd-a212-66e83611f7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:58.178926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b33b18-9204-4dbd-a212-66e83611f7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:58.179461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b33b18-9204-4dbd-a212-66e83611f7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:58.179961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b33b18-9204-4dbd-a212-66e83611f7f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:58.181136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b33b18-9204-4dbd-a212-66e83611f7f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:58.181735 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b33b18-9204-4dbd-a212-66e83611f7f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:58.183408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b33b18-9204-4dbd-a212-66e83611f7f0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:58.195582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 277/553] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:58.195582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c2e2d-6800-488b-91a5-a49d37ee2a65 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:58.199503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 277/554] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:00:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:58.205049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b33b18-9204-4dbd-a212-66e83611f7f0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:58.252759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:58.313500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c2e2d-6800-488b-91a5-a49d37ee2a65 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:58.316181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:58.356871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b33b18-9204-4dbd-a212-66e83611f7f0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:58.358406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490cca7-5169-4846-9069-838dd8078238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:58.360090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490cca7-5169-4846-9069-838dd8078238 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:58.360366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490cca7-5169-4846-9069-838dd8078238 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:58.360649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490cca7-5169-4846-9069-838dd8078238 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:58.361587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490cca7-5169-4846-9069-838dd8078238 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:58.361902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490cca7-5169-4846-9069-838dd8078238 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:58.363374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490cca7-5169-4846-9069-838dd8078238 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:58.386530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 278/555] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 15:00:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:58.387444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490cca7-5169-4846-9069-838dd8078238 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:58.409082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304846e9-b46b-4b28-b35e-9e88fef516a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:58.410599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304846e9-b46b-4b28-b35e-9e88fef516a4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:58.411078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304846e9-b46b-4b28-b35e-9e88fef516a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:58.411540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304846e9-b46b-4b28-b35e-9e88fef516a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:58.428075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304846e9-b46b-4b28-b35e-9e88fef516a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:58.430045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304846e9-b46b-4b28-b35e-9e88fef516a4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-304846e9-b46b-4b28-b35e-9e88fef516a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:58.452576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:58.453430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:58.454283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:58.454283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:58.454283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:58.454283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:58.454283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 278/556] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:00:58.455446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304846e9-b46b-4b28-b35e-9e88fef516a4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:58.503113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490cca7-5169-4846-9069-838dd8078238 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:58.538741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33eae1-7ed6-4e99-a739-0b959ada72b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:58.539529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33eae1-7ed6-4e99-a739-0b959ada72b2 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:58.539921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33eae1-7ed6-4e99-a739-0b959ada72b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:58.540204 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33eae1-7ed6-4e99-a739-0b959ada72b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:58.549441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:58.551882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33eae1-7ed6-4e99-a739-0b959ada72b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-ec33eae1-7ed6-4e99-a739-0b959ada72b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:58.559891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:58.560890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:58.562177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 279/557] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:00:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:58.562852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ec49e-7943-4c50-801e-da968daae82b None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:58.562852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ec49e-7943-4c50-801e-da968daae82b None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:58.562983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ec49e-7943-4c50-801e-da968daae82b None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:58.568445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 280/558] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:58.569214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ec49e-7943-4c50-801e-da968daae82b None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:58.574639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304846e9-b46b-4b28-b35e-9e88fef516a4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:58.595408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:58.612689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919d608-58ac-48bf-9d00-54a5031a6509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:58.613375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919d608-58ac-48bf-9d00-54a5031a6509 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:58.613646 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919d608-58ac-48bf-9d00-54a5031a6509 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:58.613926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919d608-58ac-48bf-9d00-54a5031a6509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:58.677439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ec49e-7943-4c50-801e-da968daae82b None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:58.683678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919d608-58ac-48bf-9d00-54a5031a6509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:58.685438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919d608-58ac-48bf-9d00-54a5031a6509 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:58.713602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b054fa-d003-4a30-bde8-c70d68cd301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:58.714268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b054fa-d003-4a30-bde8-c70d68cd301c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:58.714554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b054fa-d003-4a30-bde8-c70d68cd301c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:58.714832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b054fa-d003-4a30-bde8-c70d68cd301c None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:58.715670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b054fa-d003-4a30-bde8-c70d68cd301c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:58.715987 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b054fa-d003-4a30-bde8-c70d68cd301c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:58.717398 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b054fa-d003-4a30-bde8-c70d68cd301c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:58.730026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 281/559] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:58.730846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b054fa-d003-4a30-bde8-c70d68cd301c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:58.776142 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:58.798997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 279/560] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:00:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:00:58.801227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf2703-ad53-4f49-951a-8b6c2e198630 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:58.801588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf2703-ad53-4f49-951a-8b6c2e198630 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:58.801931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf2703-ad53-4f49-951a-8b6c2e198630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:58.815229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:58.823538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d5bf2703-ad53-4f49-951a-8b6c2e198630 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:58.825320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d5bf2703-ad53-4f49-951a-8b6c2e198630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:58.833255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b054fa-d003-4a30-bde8-c70d68cd301c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:58.867542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63300296-0236-454f-8ac3-15377f4daab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:58.868187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63300296-0236-454f-8ac3-15377f4daab4 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:58.868475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63300296-0236-454f-8ac3-15377f4daab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:58.868760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63300296-0236-454f-8ac3-15377f4daab4 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:58.869526 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63300296-0236-454f-8ac3-15377f4daab4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:58.869839 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63300296-0236-454f-8ac3-15377f4daab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:58.871235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63300296-0236-454f-8ac3-15377f4daab4 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:58.884429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 282/561] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:00:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:58.884429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63300296-0236-454f-8ac3-15377f4daab4 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:58.907643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 280/562] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:58.908655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf2703-ad53-4f49-951a-8b6c2e198630 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:58.994450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63300296-0236-454f-8ac3-15377f4daab4 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:59.012913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf2703-ad53-4f49-951a-8b6c2e198630 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:59.028631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:59.030420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557fd86-5ceb-4020-b0fc-ddfdda0b6129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:59.031254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557fd86-5ceb-4020-b0fc-ddfdda0b6129 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.031488 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557fd86-5ceb-4020-b0fc-ddfdda0b6129 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.031785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557fd86-5ceb-4020-b0fc-ddfdda0b6129 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.039792 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557fd86-5ceb-4020-b0fc-ddfdda0b6129 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:59.041261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557fd86-5ceb-4020-b0fc-ddfdda0b6129 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:59.052071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a830230-f985-477d-89eb-d562db3d017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:59.052882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a830230-f985-477d-89eb-d562db3d017e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.053166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a830230-f985-477d-89eb-d562db3d017e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.053442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a830230-f985-477d-89eb-d562db3d017e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-2557fd86-5ceb-4020-b0fc-ddfdda0b6129 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:00:59.056562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:59.057677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:59.058888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:59.058888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:59.058888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:00:59.058888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:00:59.058888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:00:59.058888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:00:59.058888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:00:59.058888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:00:59.058888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:00:59.058888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:59.065445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 283/563] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 15:00:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:59.065445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557fd86-5ceb-4020-b0fc-ddfdda0b6129 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:59.067048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:59.067770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a830230-f985-477d-89eb-d562db3d017e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:59.069274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a830230-f985-477d-89eb-d562db3d017e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-5a830230-f985-477d-89eb-d562db3d017e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:59.088137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:59.089256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:59.090192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:59.090192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:59.090192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:59.090192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:59.090192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 281/564] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:59.090192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a830230-f985-477d-89eb-d562db3d017e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:59.174746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557fd86-5ceb-4020-b0fc-ddfdda0b6129 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:59.200397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a830230-f985-477d-89eb-d562db3d017e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:59.211011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69e1b1-5f02-49e8-862b-a5f92c6ee320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:59.211857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69e1b1-5f02-49e8-862b-a5f92c6ee320 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.212339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69e1b1-5f02-49e8-862b-a5f92c6ee320 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.212472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69e1b1-5f02-49e8-862b-a5f92c6ee320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.225275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69e1b1-5f02-49e8-862b-a5f92c6ee320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:59.226902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69e1b1-5f02-49e8-862b-a5f92c6ee320 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:59.237657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944a8a1-2bf8-4b24-960e-5066b7edae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:59.238490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944a8a1-2bf8-4b24-960e-5066b7edae85 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.238782 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944a8a1-2bf8-4b24-960e-5066b7edae85 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.239064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944a8a1-2bf8-4b24-960e-5066b7edae85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-8e69e1b1-5f02-49e8-862b-a5f92c6ee320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:59.246979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:59.248114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:59.249057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:59.249057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:59.249057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:59.249057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:59.249057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 284/565] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:59.249390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69e1b1-5f02-49e8-862b-a5f92c6ee320 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:59.256140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944a8a1-2bf8-4b24-960e-5066b7edae85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7944a8a1-2bf8-4b24-960e-5066b7edae85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:00:59.264059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:59.264991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:59.265838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 282/566] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:00:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:59.267506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944a8a1-2bf8-4b24-960e-5066b7edae85 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:59.293303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:59.313629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:59.360743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69e1b1-5f02-49e8-862b-a5f92c6ee320 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:59.372713 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944a8a1-2bf8-4b24-960e-5066b7edae85 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:59.396884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcee8c-f08d-4cc9-bb61-77a9ca7f7915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:59.397667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcee8c-f08d-4cc9-bb61-77a9ca7f7915 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.398071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcee8c-f08d-4cc9-bb61-77a9ca7f7915 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.398667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcee8c-f08d-4cc9-bb61-77a9ca7f7915 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.399522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcee8c-f08d-4cc9-bb61-77a9ca7f7915 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:59.399866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcee8c-f08d-4cc9-bb61-77a9ca7f7915 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:59.401519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcee8c-f08d-4cc9-bb61-77a9ca7f7915 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:59.405846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3100324-717d-40a9-a6db-4188feee888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:59.406541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3100324-717d-40a9-a6db-4188feee888b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.406834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3100324-717d-40a9-a6db-4188feee888b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.407138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3100324-717d-40a9-a6db-4188feee888b None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.407951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3100324-717d-40a9-a6db-4188feee888b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:59.408266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3100324-717d-40a9-a6db-4188feee888b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:59.409703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3100324-717d-40a9-a6db-4188feee888b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:59.419369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 285/567] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 15:00:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:59.420340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcee8c-f08d-4cc9-bb61-77a9ca7f7915 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:59.423216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 283/568] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:59.436829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3100324-717d-40a9-a6db-4188feee888b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:59.512685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:59.527891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcee8c-f08d-4cc9-bb61-77a9ca7f7915 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:59.530072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3100324-717d-40a9-a6db-4188feee888b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:59.542788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:59.562673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840ab36-6e4e-4008-93e7-137c6c1d0fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:59.563267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09897288-976c-463f-bbd3-146042e96e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:59.563388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840ab36-6e4e-4008-93e7-137c6c1d0fce None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.563619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840ab36-6e4e-4008-93e7-137c6c1d0fce None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.563898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840ab36-6e4e-4008-93e7-137c6c1d0fce None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.564005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09897288-976c-463f-bbd3-146042e96e2d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.564251 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09897288-976c-463f-bbd3-146042e96e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.564532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09897288-976c-463f-bbd3-146042e96e2d None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.564635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840ab36-6e4e-4008-93e7-137c6c1d0fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:59.564972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840ab36-6e4e-4008-93e7-137c6c1d0fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:59.565346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09897288-976c-463f-bbd3-146042e96e2d None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:00:59.565655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09897288-976c-463f-bbd3-146042e96e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:59.566358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840ab36-6e4e-4008-93e7-137c6c1d0fce None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:59.567002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09897288-976c-463f-bbd3-146042e96e2d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:59.575364 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 284/569] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:00:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:59.576621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66684c6c-5bfc-4b78-b38e-25bd24c478a0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.576909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66684c6c-5bfc-4b78-b38e-25bd24c478a0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.577190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66684c6c-5bfc-4b78-b38e-25bd24c478a0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.578057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 286/570] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:00:59.578524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 285/571] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:00:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:00:59.579100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66684c6c-5bfc-4b78-b38e-25bd24c478a0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:59.579998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840ab36-6e4e-4008-93e7-137c6c1d0fce None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:59.682946 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840ab36-6e4e-4008-93e7-137c6c1d0fce None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:59.683981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66684c6c-5bfc-4b78-b38e-25bd24c478a0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:59.715853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c196c7-871c-48ba-8a18-daac352f1b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:59.716583 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c196c7-871c-48ba-8a18-daac352f1b4b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.716756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd15a24-9c8d-4797-8d37-f2f6e441d608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:59.716872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c196c7-871c-48ba-8a18-daac352f1b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.717124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c196c7-871c-48ba-8a18-daac352f1b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.717546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd15a24-9c8d-4797-8d37-f2f6e441d608 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.717829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd15a24-9c8d-4797-8d37-f2f6e441d608 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.718101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd15a24-9c8d-4797-8d37-f2f6e441d608 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.724890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd15a24-9c8d-4797-8d37-f2f6e441d608 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:59.726430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd15a24-9c8d-4797-8d37-f2f6e441d608 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:59.727781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c196c7-871c-48ba-8a18-daac352f1b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:59.729213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c196c7-871c-48ba-8a18-daac352f1b4b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7fd15a24-9c8d-4797-8d37-f2f6e441d608 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:00:59.740744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:59.741915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:59.747613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:00:59.747613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:00:59.747613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:00:59.747613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:00:59.747613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:00:59.747613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:00:59.747613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:00:59.747613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:59.747613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 286/572] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:00:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:59.747613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd15a24-9c8d-4797-8d37-f2f6e441d608 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-44c196c7-871c-48ba-8a18-daac352f1b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:59.748225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:59.749034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:59.749956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:59.749956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:59.749956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:59.749956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:00:59.749956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 287/573] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:59.749956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307af51-c142-42b3-a848-c7a586365224 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.749956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307af51-c142-42b3-a848-c7a586365224 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.749956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307af51-c142-42b3-a848-c7a586365224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.751596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:59.766589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-8307af51-c142-42b3-a848-c7a586365224 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:00:59.767800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-8307af51-c142-42b3-a848-c7a586365224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:00:59.788144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:59.838836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 288/574] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:00:59.838836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307af51-c142-42b3-a848-c7a586365224 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:59.848867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd15a24-9c8d-4797-8d37-f2f6e441d608 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:59.882985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550b3eb-f924-4de3-a3d0-4b4e1f3cb2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:59.883812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550b3eb-f924-4de3-a3d0-4b4e1f3cb2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.884076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550b3eb-f924-4de3-a3d0-4b4e1f3cb2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.884370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550b3eb-f924-4de3-a3d0-4b4e1f3cb2d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.894106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550b3eb-f924-4de3-a3d0-4b4e1f3cb2d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:00:59.895587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550b3eb-f924-4de3-a3d0-4b4e1f3cb2d5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2550b3eb-f924-4de3-a3d0-4b4e1f3cb2d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:00:59.912764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:00:59.914089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:00:59.915180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:00:59.915180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:00:59.915180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:00:59.915180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:00:59.915180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 287/575] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:00:59.915180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550b3eb-f924-4de3-a3d0-4b4e1f3cb2d5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:00:59.957215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307af51-c142-42b3-a848-c7a586365224 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:00:59.972361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:00:59.990038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f7486-d14b-41ff-a3e3-501150812adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:00:59.990861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f7486-d14b-41ff-a3e3-501150812adb None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:00:59.991128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f7486-d14b-41ff-a3e3-501150812adb None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:00:59.991405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f7486-d14b-41ff-a3e3-501150812adb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:00:59.998597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f7486-d14b-41ff-a3e3-501150812adb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:00.000090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f7486-d14b-41ff-a3e3-501150812adb None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:00.011949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550b3eb-f924-4de3-a3d0-4b4e1f3cb2d5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-ba5f7486-d14b-41ff-a3e3-501150812adb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:00.014752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:00.015848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:00.016953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:00.016953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:00.016953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:00.016953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:00.016953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:00.016953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:00.016953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:00.016953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:00.016953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 15:01:00.016953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:00.019717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 289/576] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:00:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:00.020699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f7486-d14b-41ff-a3e3-501150812adb None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.040040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:00.046211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d026f8d-12e8-4542-9388-1766d2ce23e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:00.046963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d026f8d-12e8-4542-9388-1766d2ce23e9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:00.047249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d026f8d-12e8-4542-9388-1766d2ce23e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:00.047525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d026f8d-12e8-4542-9388-1766d2ce23e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:00.048346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d026f8d-12e8-4542-9388-1766d2ce23e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:00.048643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d026f8d-12e8-4542-9388-1766d2ce23e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:00.050230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d026f8d-12e8-4542-9388-1766d2ce23e9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:00.061537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 288/577] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:00:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:00.062326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d026f8d-12e8-4542-9388-1766d2ce23e9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.122272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f7486-d14b-41ff-a3e3-501150812adb None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.158584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4903fb-16af-40c5-97a7-cf4d00316d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:00.158792 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d026f8d-12e8-4542-9388-1766d2ce23e9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.159303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4903fb-16af-40c5-97a7-cf4d00316d0e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:00.159616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4903fb-16af-40c5-97a7-cf4d00316d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:00.159897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4903fb-16af-40c5-97a7-cf4d00316d0e None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:00.160636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4903fb-16af-40c5-97a7-cf4d00316d0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:00.160947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4903fb-16af-40c5-97a7-cf4d00316d0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:00.162345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4903fb-16af-40c5-97a7-cf4d00316d0e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:00.173570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 290/578] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:00.174360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4903fb-16af-40c5-97a7-cf4d00316d0e None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.178910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:00.192507 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7343ea-f77a-40c3-9d6b-1369cc100702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:00.193323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7343ea-f77a-40c3-9d6b-1369cc100702 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:00.193616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7343ea-f77a-40c3-9d6b-1369cc100702 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:00.193899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7343ea-f77a-40c3-9d6b-1369cc100702 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:00.203972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7343ea-f77a-40c3-9d6b-1369cc100702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ef7343ea-f77a-40c3-9d6b-1369cc100702 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:00.211836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:00.212816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:00.213663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 289/579] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:01:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:00.214390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7343ea-f77a-40c3-9d6b-1369cc100702 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.255368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:00.280585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4903fb-16af-40c5-97a7-cf4d00316d0e None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.313538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7343ea-f77a-40c3-9d6b-1369cc100702 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.316726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225be092-726e-41ee-898a-23eb45ab76b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:00.317388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be092-726e-41ee-898a-23eb45ab76b1 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:00.317667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be092-726e-41ee-898a-23eb45ab76b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:00.317938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be092-726e-41ee-898a-23eb45ab76b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:00.318662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225be092-726e-41ee-898a-23eb45ab76b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:00.318965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225be092-726e-41ee-898a-23eb45ab76b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:00.320384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225be092-726e-41ee-898a-23eb45ab76b1 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:00.332169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 291/580] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:00.332941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225be092-726e-41ee-898a-23eb45ab76b1 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.351132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387d49f-c8e8-4989-9c16-0a3642809f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:00.351842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387d49f-c8e8-4989-9c16-0a3642809f11 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:00.352133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387d49f-c8e8-4989-9c16-0a3642809f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:00.352413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387d49f-c8e8-4989-9c16-0a3642809f11 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:00.353266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387d49f-c8e8-4989-9c16-0a3642809f11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:00.353591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387d49f-c8e8-4989-9c16-0a3642809f11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:00.355015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387d49f-c8e8-4989-9c16-0a3642809f11 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:00.371638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 290/581] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 15:01:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:00.372431 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387d49f-c8e8-4989-9c16-0a3642809f11 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.406678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:00.433019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225be092-726e-41ee-898a-23eb45ab76b1 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.468059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ff55e-ccc2-4b54-8d67-2008617b1414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:00.468727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ff55e-ccc2-4b54-8d67-2008617b1414 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:00.469027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ff55e-ccc2-4b54-8d67-2008617b1414 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:00.469272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ff55e-ccc2-4b54-8d67-2008617b1414 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:00.470116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ff55e-ccc2-4b54-8d67-2008617b1414 None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=1643cf33cd3b417bb2cd15b5503f7ffd) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:00.470431 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ff55e-ccc2-4b54-8d67-2008617b1414 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:00.471922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ff55e-ccc2-4b54-8d67-2008617b1414 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:00.472212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387d49f-c8e8-4989-9c16-0a3642809f11 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.474815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:00.478374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 292/582] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:00 2022] GET /identity/v3/role_assignments?user.id=1643cf33cd3b417bb2cd15b5503f7ffd&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:00.479245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ff55e-ccc2-4b54-8d67-2008617b1414 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.511151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe31c7-c9d2-45bd-b2e0-393a4bd6e818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:00.511918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe31c7-c9d2-45bd-b2e0-393a4bd6e818 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:00.512202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe31c7-c9d2-45bd-b2e0-393a4bd6e818 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:00.512477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe31c7-c9d2-45bd-b2e0-393a4bd6e818 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:00.520806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe31c7-c9d2-45bd-b2e0-393a4bd6e818 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:00.522414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe31c7-c9d2-45bd-b2e0-393a4bd6e818 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b2fe31c7-c9d2-45bd-b2e0-393a4bd6e818 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:00.537918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:00.538911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:00.539857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:00.539857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:00.539857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:00.539857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:00.539857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:00.539857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:00.539857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:00.539857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:00.541604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 291/583] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:00.542760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe31c7-c9d2-45bd-b2e0-393a4bd6e818 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.607141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ff55e-ccc2-4b54-8d67-2008617b1414 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.649906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f288272-05f5-403f-b3d8-8bde40431c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:00.650596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f288272-05f5-403f-b3d8-8bde40431c8a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:00.650883 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f288272-05f5-403f-b3d8-8bde40431c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:00.651166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f288272-05f5-403f-b3d8-8bde40431c8a None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:00.651964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f288272-05f5-403f-b3d8-8bde40431c8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:00.652281 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f288272-05f5-403f-b3d8-8bde40431c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:00.653688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f288272-05f5-403f-b3d8-8bde40431c8a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:00.663090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 293/584] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:01:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:00.663670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f288272-05f5-403f-b3d8-8bde40431c8a None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.682278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:00.689465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe31c7-c9d2-45bd-b2e0-393a4bd6e818 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.724523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad77e5d-613e-440d-a3ae-2e4b9a63dd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:00.725496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad77e5d-613e-440d-a3ae-2e4b9a63dd12 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:00.725877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad77e5d-613e-440d-a3ae-2e4b9a63dd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:00.726232 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad77e5d-613e-440d-a3ae-2e4b9a63dd12 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:00.728438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:00.734532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad77e5d-613e-440d-a3ae-2e4b9a63dd12 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:00.736085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad77e5d-613e-440d-a3ae-2e4b9a63dd12 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-bad77e5d-613e-440d-a3ae-2e4b9a63dd12 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:00.751158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:00.752402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:00.753638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:00.753638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:00.753638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:00.753638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:00.753638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:00.753638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:00.753638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:00.753638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:00.753638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:01:00.753638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:00.757236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 292/585] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:01:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:00.758074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad77e5d-613e-440d-a3ae-2e4b9a63dd12 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.773581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f288272-05f5-403f-b3d8-8bde40431c8a None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.808949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f4107-6f02-40d6-bdbd-e7b1c22bb94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:00.809899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f4107-6f02-40d6-bdbd-e7b1c22bb94f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:00.810189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f4107-6f02-40d6-bdbd-e7b1c22bb94f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:00.810751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f4107-6f02-40d6-bdbd-e7b1c22bb94f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:00.823962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f4107-6f02-40d6-bdbd-e7b1c22bb94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:00.825431 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f4107-6f02-40d6-bdbd-e7b1c22bb94f None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-de4f4107-6f02-40d6-bdbd-e7b1c22bb94f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:00.843203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:00.844589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:00.846318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:00.846318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:00.846318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:00.846318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:00.846318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 294/586] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:00.846318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f4107-6f02-40d6-bdbd-e7b1c22bb94f None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.867056 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad77e5d-613e-440d-a3ae-2e4b9a63dd12 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.904468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce19283-ba8a-4f2c-a713-7b3bed9805db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:00.905150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce19283-ba8a-4f2c-a713-7b3bed9805db None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:00.905439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce19283-ba8a-4f2c-a713-7b3bed9805db None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:00.905723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce19283-ba8a-4f2c-a713-7b3bed9805db None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:00.906533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce19283-ba8a-4f2c-a713-7b3bed9805db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:00.906859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce19283-ba8a-4f2c-a713-7b3bed9805db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:00.908510 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce19283-ba8a-4f2c-a713-7b3bed9805db None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:00.920924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 293/587] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:00.921737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce19283-ba8a-4f2c-a713-7b3bed9805db None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:00.941435 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:00.964276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f4107-6f02-40d6-bdbd-e7b1c22bb94f None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:00.978473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:01.001518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05190a-18d5-4f60-9897-b61e3df38681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:01.002333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05190a-18d5-4f60-9897-b61e3df38681 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.002937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05190a-18d5-4f60-9897-b61e3df38681 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.003328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05190a-18d5-4f60-9897-b61e3df38681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.014813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05190a-18d5-4f60-9897-b61e3df38681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:01.016340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05190a-18d5-4f60-9897-b61e3df38681 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.028996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce19283-ba8a-4f2c-a713-7b3bed9805db None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-dd05190a-18d5-4f60-9897-b61e3df38681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:01.034163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:01.035137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:01.036074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:01.036074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:01.036074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:01.036074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:01.039961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 295/588] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:01.041287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05190a-18d5-4f60-9897-b61e3df38681 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:01.064796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a550d5d-3c16-4088-b845-dac03750d15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:01.065495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a550d5d-3c16-4088-b845-dac03750d15b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.065838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a550d5d-3c16-4088-b845-dac03750d15b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.066102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a550d5d-3c16-4088-b845-dac03750d15b None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.066971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a550d5d-3c16-4088-b845-dac03750d15b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:01.067279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a550d5d-3c16-4088-b845-dac03750d15b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:01.068739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a550d5d-3c16-4088-b845-dac03750d15b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.092757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 294/589] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 15:01:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:01.093732 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a550d5d-3c16-4088-b845-dac03750d15b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:01.145884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05190a-18d5-4f60-9897-b61e3df38681 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:01.172266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:01.181553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8982a-3d7f-4909-ac9e-5671212fded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:01.182497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8982a-3d7f-4909-ac9e-5671212fded8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.182785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8982a-3d7f-4909-ac9e-5671212fded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.183214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8982a-3d7f-4909-ac9e-5671212fded8 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.184282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8982a-3d7f-4909-ac9e-5671212fded8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:01.184600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8982a-3d7f-4909-ac9e-5671212fded8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:01.185992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8982a-3d7f-4909-ac9e-5671212fded8 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.198989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 296/590] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:01.199866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8982a-3d7f-4909-ac9e-5671212fded8 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:01.202022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a550d5d-3c16-4088-b845-dac03750d15b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:01.228758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:01.240689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84823a2-af34-4514-9c6e-e8f8085f8366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:01.241602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84823a2-af34-4514-9c6e-e8f8085f8366 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.241888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84823a2-af34-4514-9c6e-e8f8085f8366 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.242193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84823a2-af34-4514-9c6e-e8f8085f8366 None admin] PATH_INFO: `/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/f553cee02ab345dabbef807bfe85544a/roles/4e05103edb314958aba7aa66c8747306` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.258377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84823a2-af34-4514-9c6e-e8f8085f8366 None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ad2e4552f43f09ebf85b6c82a5481, user_id=f553cee02ab345dabbef807bfe85544a, role_id=4e05103edb314958aba7aa66c8747306)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:01.259860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84823a2-af34-4514-9c6e-e8f8085f8366 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.273317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 295/591] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:01:01 2022] PUT /identity/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/f553cee02ab345dabbef807bfe85544a/roles/4e05103edb314958aba7aa66c8747306 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:01.274135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84823a2-af34-4514-9c6e-e8f8085f8366 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:01.326077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8982a-3d7f-4909-ac9e-5671212fded8 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:01.364285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c831b06-94f9-406b-b9cb-0ee3fa8d5530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:01.365030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c831b06-94f9-406b-b9cb-0ee3fa8d5530 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.365314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c831b06-94f9-406b-b9cb-0ee3fa8d5530 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.365590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c831b06-94f9-406b-b9cb-0ee3fa8d5530 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.366446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c831b06-94f9-406b-b9cb-0ee3fa8d5530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:01.366758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c831b06-94f9-406b-b9cb-0ee3fa8d5530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:01.368232 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c831b06-94f9-406b-b9cb-0ee3fa8d5530 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.385675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 297/592] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:01.385675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c831b06-94f9-406b-b9cb-0ee3fa8d5530 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:01.430715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84823a2-af34-4514-9c6e-e8f8085f8366 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:01.462524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:01.476591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256ebbe-c3e9-4ceb-a533-8de78db4a30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:01.477893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256ebbe-c3e9-4ceb-a533-8de78db4a30c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.477893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256ebbe-c3e9-4ceb-a533-8de78db4a30c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.478094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256ebbe-c3e9-4ceb-a533-8de78db4a30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.489121 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256ebbe-c3e9-4ceb-a533-8de78db4a30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:01.490437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:01.490623 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256ebbe-c3e9-4ceb-a533-8de78db4a30c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.509220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c831b06-94f9-406b-b9cb-0ee3fa8d5530 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3256ebbe-c3e9-4ceb-a533-8de78db4a30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:01.512564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:01.513471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:01.514369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:01.514369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:01.514369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:01.514369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:01.518286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 296/593] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:01.519245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256ebbe-c3e9-4ceb-a533-8de78db4a30c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:01.558491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af93e88-a327-493a-b5c2-6b67a070b6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:01.559777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af93e88-a327-493a-b5c2-6b67a070b6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.560268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af93e88-a327-493a-b5c2-6b67a070b6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.560730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af93e88-a327-493a-b5c2-6b67a070b6a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.570865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af93e88-a327-493a-b5c2-6b67a070b6a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:01.573167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af93e88-a327-493a-b5c2-6b67a070b6a8 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-3af93e88-a327-493a-b5c2-6b67a070b6a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:01.594587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:01.595537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:01.596481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:01.596481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:01.596481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:01.596481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:01.596481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:01.596481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:01.596481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:01.596481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:01.597777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 298/594] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:01.598441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af93e88-a327-493a-b5c2-6b67a070b6a8 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:01.649429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256ebbe-c3e9-4ceb-a533-8de78db4a30c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:01.693585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fecf02-3777-42d4-a1a4-8f0063165a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:01.694407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fecf02-3777-42d4-a1a4-8f0063165a70 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.694689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fecf02-3777-42d4-a1a4-8f0063165a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.694965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fecf02-3777-42d4-a1a4-8f0063165a70 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.704230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fecf02-3777-42d4-a1a4-8f0063165a70 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:01.706078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fecf02-3777-42d4-a1a4-8f0063165a70 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-06fecf02-3777-42d4-a1a4-8f0063165a70 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:01.724230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:01.725236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:01.726179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:01.726179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:01.726179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:01.726179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:01.726179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:01.726179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:01.726179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:01.726179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:01.726179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:01:01.726179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:01.728589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 297/595] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:01:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:01.729581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fecf02-3777-42d4-a1a4-8f0063165a70 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:01.734223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af93e88-a327-493a-b5c2-6b67a070b6a8 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:01.767778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:01.770017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a510f36-2e4b-4146-9445-6a72dbc49259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:01.770766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a510f36-2e4b-4146-9445-6a72dbc49259 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.771335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a510f36-2e4b-4146-9445-6a72dbc49259 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.771658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a510f36-2e4b-4146-9445-6a72dbc49259 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.772538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a510f36-2e4b-4146-9445-6a72dbc49259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:01.772852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a510f36-2e4b-4146-9445-6a72dbc49259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:01.774412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a510f36-2e4b-4146-9445-6a72dbc49259 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.790944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 299/596] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:01.791912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a510f36-2e4b-4146-9445-6a72dbc49259 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:01.801493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:01.844310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fecf02-3777-42d4-a1a4-8f0063165a70 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:01.881937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488b625-969f-429d-aae9-430820f986a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:01.882921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488b625-969f-429d-aae9-430820f986a4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.883388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488b625-969f-429d-aae9-430820f986a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.883877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488b625-969f-429d-aae9-430820f986a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.885025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488b625-969f-429d-aae9-430820f986a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:01.885516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488b625-969f-429d-aae9-430820f986a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:01.887303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488b625-969f-429d-aae9-430820f986a4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.896482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a510f36-2e4b-4146-9445-6a72dbc49259 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:01.901650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 298/597] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:01.902699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488b625-969f-429d-aae9-430820f986a4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:01.931679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36726292-627f-4021-ae47-016630ebe057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:01.932362 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36726292-627f-4021-ae47-016630ebe057 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:01.932647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36726292-627f-4021-ae47-016630ebe057 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:01.932926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36726292-627f-4021-ae47-016630ebe057 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:01.933775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36726292-627f-4021-ae47-016630ebe057 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:01.934088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36726292-627f-4021-ae47-016630ebe057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:01.935521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36726292-627f-4021-ae47-016630ebe057 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:01.958291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 300/598] 10.222.0.24 () {56 vars in 1139 bytes} [Wed May 25 15:01:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:01.959147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36726292-627f-4021-ae47-016630ebe057 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:02.007298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:02.014395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488b625-969f-429d-aae9-430820f986a4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:02.022729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:02.054665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e8f64-abdd-4cd8-831b-ad471fc0b671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:02.056025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8f64-abdd-4cd8-831b-ad471fc0b671 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:02.056572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8f64-abdd-4cd8-831b-ad471fc0b671 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:02.057054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8f64-abdd-4cd8-831b-ad471fc0b671 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:02.061550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36726292-627f-4021-ae47-016630ebe057 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:02.065115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e8f64-abdd-4cd8-831b-ad471fc0b671 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:02.066919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e8f64-abdd-4cd8-831b-ad471fc0b671 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-032e8f64-abdd-4cd8-831b-ad471fc0b671 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:02.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:02.083899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:02.084795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:02.084795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:02.084795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:02.084795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:02.084795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:02.084795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:02.084795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:02.084795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:02.087394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 299/599] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:02.088575 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e8f64-abdd-4cd8-831b-ad471fc0b671 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:02.102247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee4936-22dd-4b4f-9ed2-aaedd604608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:02.102965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee4936-22dd-4b4f-9ed2-aaedd604608b None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:02.103251 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee4936-22dd-4b4f-9ed2-aaedd604608b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:02.103529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee4936-22dd-4b4f-9ed2-aaedd604608b None admin] PATH_INFO: `/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/79f0aa2ddbcb494f8a5a53399793aa2e/roles/4e05103edb314958aba7aa66c8747306` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:02.120485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee4936-22dd-4b4f-9ed2-aaedd604608b None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ad2e4552f43f09ebf85b6c82a5481, user_id=79f0aa2ddbcb494f8a5a53399793aa2e, role_id=4e05103edb314958aba7aa66c8747306)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:02.121941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee4936-22dd-4b4f-9ed2-aaedd604608b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:02.136473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 301/600] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:01:01 2022] PUT /identity/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/79f0aa2ddbcb494f8a5a53399793aa2e/roles/4e05103edb314958aba7aa66c8747306 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:02.137372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee4936-22dd-4b4f-9ed2-aaedd604608b None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:02.209392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e8f64-abdd-4cd8-831b-ad471fc0b671 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:02.249148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee4936-22dd-4b4f-9ed2-aaedd604608b None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:02.250957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7ee07-e5b6-4e46-9ca4-9627a325eec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:02.252244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7ee07-e5b6-4e46-9ca4-9627a325eec5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:02.252772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7ee07-e5b6-4e46-9ca4-9627a325eec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:02.253332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7ee07-e5b6-4e46-9ca4-9627a325eec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:02.265820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:02.267346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7ee07-e5b6-4e46-9ca4-9627a325eec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:02.269163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7ee07-e5b6-4e46-9ca4-9627a325eec5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:02.289457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41569460-5198-4df4-b602-343ca905ac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:02.290132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569460-5198-4df4-b602-343ca905ac7a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:02.290418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569460-5198-4df4-b602-343ca905ac7a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:02.290699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569460-5198-4df4-b602-343ca905ac7a None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:02.291511 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41569460-5198-4df4-b602-343ca905ac7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:02.291862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41569460-5198-4df4-b602-343ca905ac7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:02.293306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41569460-5198-4df4-b602-343ca905ac7a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-63d7ee07-e5b6-4e46-9ca4-9627a325eec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:02.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:02.294705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:02.295673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:02.295673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:02.295673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:02.295673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:02.298073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 300/601] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:02.314005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7ee07-e5b6-4e46-9ca4-9627a325eec5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:02.316859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 302/602] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:02.318359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41569460-5198-4df4-b602-343ca905ac7a None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:02.342476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:02.426356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41569460-5198-4df4-b602-343ca905ac7a None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:02.469118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1d92f-a82c-4077-b3fe-433b2dc5b6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:02.470026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1d92f-a82c-4077-b3fe-433b2dc5b6ce None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:02.470309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1d92f-a82c-4077-b3fe-433b2dc5b6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:02.470584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1d92f-a82c-4077-b3fe-433b2dc5b6ce None admin] PATH_INFO: `/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/49e5814865044696a7d0021d44629604/roles/4e05103edb314958aba7aa66c8747306` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:02.476729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7ee07-e5b6-4e46-9ca4-9627a325eec5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:02.486123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1d92f-a82c-4077-b3fe-433b2dc5b6ce None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ad2e4552f43f09ebf85b6c82a5481, user_id=49e5814865044696a7d0021d44629604, role_id=4e05103edb314958aba7aa66c8747306)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:02.487645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1d92f-a82c-4077-b3fe-433b2dc5b6ce None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:02.512881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 303/603] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:01:02 2022] PUT /identity/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/49e5814865044696a7d0021d44629604/roles/4e05103edb314958aba7aa66c8747306 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:02.530206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8dd3-81d0-4996-9ff4-d3b11714a318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:02.530890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8dd3-81d0-4996-9ff4-d3b11714a318 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:02.531176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8dd3-81d0-4996-9ff4-d3b11714a318 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:02.531455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8dd3-81d0-4996-9ff4-d3b11714a318 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:02.532230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a8dd3-81d0-4996-9ff4-d3b11714a318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:02.532535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a8dd3-81d0-4996-9ff4-d3b11714a318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:02.533903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a8dd3-81d0-4996-9ff4-d3b11714a318 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:02.554166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 301/604] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:02.560137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1d92f-a82c-4077-b3fe-433b2dc5b6ce None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:02.603983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:02.707725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1d92f-a82c-4077-b3fe-433b2dc5b6ce None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:02.746085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6918fc7-8e8b-4c66-bf49-2b5134b49e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:02.746915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6918fc7-8e8b-4c66-bf49-2b5134b49e54 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:02.747200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6918fc7-8e8b-4c66-bf49-2b5134b49e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:02.747480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6918fc7-8e8b-4c66-bf49-2b5134b49e54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:02.755429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6918fc7-8e8b-4c66-bf49-2b5134b49e54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:02.756948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6918fc7-8e8b-4c66-bf49-2b5134b49e54 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-f6918fc7-8e8b-4c66-bf49-2b5134b49e54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:02.772218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:02.773231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:02.774147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:02.774147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:02.774147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:02.774147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:02.774147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:02.774147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:02.774147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:02.774147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:02.774147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 304/605] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:02.780786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8dd3-81d0-4996-9ff4-d3b11714a318 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:02.809173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ff963-6132-49d1-b4c5-14a737e70dbc None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:02.809535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ff963-6132-49d1-b4c5-14a737e70dbc None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:02.809733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ff963-6132-49d1-b4c5-14a737e70dbc None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:02.811326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 305/606] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:02.817410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c602bbd-7756-47b4-a151-5a0454f2c36a None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:02.818020 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c602bbd-7756-47b4-a151-5a0454f2c36a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:02.818366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c602bbd-7756-47b4-a151-5a0454f2c36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:02.836762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-5c602bbd-7756-47b4-a151-5a0454f2c36a None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:02.838073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-5c602bbd-7756-47b4-a151-5a0454f2c36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:02.869389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:02.921979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8dd3-81d0-4996-9ff4-d3b11714a318 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:02.942758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 306/607] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:01:02.963382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c78782-d9b9-47da-8abf-f9225eba739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:02.964437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c78782-d9b9-47da-8abf-f9225eba739b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:02.964886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c78782-d9b9-47da-8abf-f9225eba739b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:02.965317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c78782-d9b9-47da-8abf-f9225eba739b None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:02.965577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c602bbd-7756-47b4-a151-5a0454f2c36a None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:02.966444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c78782-d9b9-47da-8abf-f9225eba739b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:02.966911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c78782-d9b9-47da-8abf-f9225eba739b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:02.969732 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c78782-d9b9-47da-8abf-f9225eba739b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:02.982151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:02.987498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 302/608] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:02.996547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c78782-d9b9-47da-8abf-f9225eba739b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:03.129560 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c602bbd-7756-47b4-a151-5a0454f2c36a None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:03.175494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c78782-d9b9-47da-8abf-f9225eba739b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:03.205701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af186a4-4942-4e6a-9a1e-eb15b667c833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:03.206528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af186a4-4942-4e6a-9a1e-eb15b667c833 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:03.206813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af186a4-4942-4e6a-9a1e-eb15b667c833 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:03.207090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af186a4-4942-4e6a-9a1e-eb15b667c833 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:03.219997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:03.228659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaa121-de70-49b8-9296-7e1c03215b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:03.230221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaa121-de70-49b8-9296-7e1c03215b7a None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:03.230758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaa121-de70-49b8-9296-7e1c03215b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:03.231229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaa121-de70-49b8-9296-7e1c03215b7a None admin] PATH_INFO: `/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/d4b24eb13be7443f9c24e55532ef95d3/roles/4e05103edb314958aba7aa66c8747306` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:03.241729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af186a4-4942-4e6a-9a1e-eb15b667c833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-0af186a4-4942-4e6a-9a1e-eb15b667c833 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:03.252462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:03.253439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:03.254438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:03.254438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:03.254438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:03.254438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:03.254438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:03.254438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:03.254438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:03.254438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:03.254438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:03.254438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:03.254438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:03.254438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:03.257434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 307/609] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:01:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:03.263992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af186a4-4942-4e6a-9a1e-eb15b667c833 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:03.269326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaa121-de70-49b8-9296-7e1c03215b7a None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ad2e4552f43f09ebf85b6c82a5481, user_id=d4b24eb13be7443f9c24e55532ef95d3, role_id=4e05103edb314958aba7aa66c8747306)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:03.270556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaa121-de70-49b8-9296-7e1c03215b7a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:03.298034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 303/610] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:01:02 2022] PUT /identity/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/d4b24eb13be7443f9c24e55532ef95d3/roles/4e05103edb314958aba7aa66c8747306 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:03.354871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:03.391160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af186a4-4942-4e6a-9a1e-eb15b667c833 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:03.445992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19221886-2e65-4d8a-9c93-b68397af3495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:03.447059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19221886-2e65-4d8a-9c93-b68397af3495 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:03.447801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19221886-2e65-4d8a-9c93-b68397af3495 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:03.448303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19221886-2e65-4d8a-9c93-b68397af3495 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:03.449278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19221886-2e65-4d8a-9c93-b68397af3495 None admin] RBAC: Adding query filter params (name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:03.449796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19221886-2e65-4d8a-9c93-b68397af3495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:03.451642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19221886-2e65-4d8a-9c93-b68397af3495 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:03.475792 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 308/611] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:01:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:03.484421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaa121-de70-49b8-9296-7e1c03215b7a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:03.619529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaa121-de70-49b8-9296-7e1c03215b7a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:03.658224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249423c9-f1e5-485b-8fa4-a998ec4477a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:03.659044 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249423c9-f1e5-485b-8fa4-a998ec4477a3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:03.659329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249423c9-f1e5-485b-8fa4-a998ec4477a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:03.659635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249423c9-f1e5-485b-8fa4-a998ec4477a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:03.671262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249423c9-f1e5-485b-8fa4-a998ec4477a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:03.672784 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249423c9-f1e5-485b-8fa4-a998ec4477a3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-249423c9-f1e5-485b-8fa4-a998ec4477a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:03.692137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:03.693092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:03.693989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:03.693989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:03.693989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:03.693989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:03.693989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 304/612] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:03.698962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19221886-2e65-4d8a-9c93-b68397af3495 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:03.803920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19221886-2e65-4d8a-9c93-b68397af3495 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:03.839212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e221e1f-ead9-4a1e-b33a-ab72a1e3f3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:03.839924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e221e1f-ead9-4a1e-b33a-ab72a1e3f3ea None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:03.840210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e221e1f-ead9-4a1e-b33a-ab72a1e3f3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:03.840484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e221e1f-ead9-4a1e-b33a-ab72a1e3f3ea None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:03.841218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e221e1f-ead9-4a1e-b33a-ab72a1e3f3ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:03.841526 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e221e1f-ead9-4a1e-b33a-ab72a1e3f3ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:03.842907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e221e1f-ead9-4a1e-b33a-ab72a1e3f3ea None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:03.845478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:03.856473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 309/613] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:03.864751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249423c9-f1e5-485b-8fa4-a998ec4477a3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:03.893032 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cfbc7-fbbe-4753-a6a7-fde16db42663 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:03.893361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cfbc7-fbbe-4753-a6a7-fde16db42663 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:03.893593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cfbc7-fbbe-4753-a6a7-fde16db42663 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:03.894969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 310/614] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:03.905053 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31f001-5967-4d97-a1b7-9b2097eaf803 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:03.905344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31f001-5967-4d97-a1b7-9b2097eaf803 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:03.905624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31f001-5967-4d97-a1b7-9b2097eaf803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:03.917596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:03.929075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-0d31f001-5967-4d97-a1b7-9b2097eaf803 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:03.932862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-0d31f001-5967-4d97-a1b7-9b2097eaf803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:03.995613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249423c9-f1e5-485b-8fa4-a998ec4477a3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.034853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78412b53-98dc-4999-ade0-ba47a4a9b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.037069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78412b53-98dc-4999-ade0-ba47a4a9b968 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.037069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78412b53-98dc-4999-ade0-ba47a4a9b968 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.037069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78412b53-98dc-4999-ade0-ba47a4a9b968 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.044969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78412b53-98dc-4999-ade0-ba47a4a9b968 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.046771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78412b53-98dc-4999-ade0-ba47a4a9b968 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.053635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 311/615] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-78412b53-98dc-4999-ade0-ba47a4a9b968 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:04.062973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:04.064145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:04.065292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:04.065292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:04.065292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:04.065292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:04.065292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:04.065292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:04.065292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:04.065292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:04.065292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 15:01:04.065292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:04.068297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 305/616] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:01:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:04.071987 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31f001-5967-4d97-a1b7-9b2097eaf803 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.087700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78412b53-98dc-4999-ade0-ba47a4a9b968 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.185474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:04.196457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78412b53-98dc-4999-ade0-ba47a4a9b968 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.235370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecde6-f13a-4c0d-8e69-52840eb36345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.236225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecde6-f13a-4c0d-8e69-52840eb36345 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.236938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecde6-f13a-4c0d-8e69-52840eb36345 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.237226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecde6-f13a-4c0d-8e69-52840eb36345 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.250735 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aecde6-f13a-4c0d-8e69-52840eb36345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-16aecde6-f13a-4c0d-8e69-52840eb36345 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:04.259707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:04.260948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:04.261767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 306/617] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:01:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:04.266837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecde6-f13a-4c0d-8e69-52840eb36345 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.375115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecde6-f13a-4c0d-8e69-52840eb36345 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.397543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31f001-5967-4d97-a1b7-9b2097eaf803 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.412806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf12db-9497-4d2f-be46-cc5f8fe749dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.413920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf12db-9497-4d2f-be46-cc5f8fe749dc None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.414325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf12db-9497-4d2f-be46-cc5f8fe749dc None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.414699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf12db-9497-4d2f-be46-cc5f8fe749dc None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.415585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf12db-9497-4d2f-be46-cc5f8fe749dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:04.415992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf12db-9497-4d2f-be46-cc5f8fe749dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.417949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf12db-9497-4d2f-be46-cc5f8fe749dc None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.428490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 307/618] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:01:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:04.440484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf12db-9497-4d2f-be46-cc5f8fe749dc None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.460885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:04.465657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:04.479372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b2d02-92c8-419a-a0e6-91abc4a5f28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.480413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b2d02-92c8-419a-a0e6-91abc4a5f28c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.480971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b2d02-92c8-419a-a0e6-91abc4a5f28c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.481529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b2d02-92c8-419a-a0e6-91abc4a5f28c None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.482591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b2d02-92c8-419a-a0e6-91abc4a5f28c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:04.483108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b2d02-92c8-419a-a0e6-91abc4a5f28c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.484969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b2d02-92c8-419a-a0e6-91abc4a5f28c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.505115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 312/619] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 15:01:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:04.510158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b2d02-92c8-419a-a0e6-91abc4a5f28c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.573543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf12db-9497-4d2f-be46-cc5f8fe749dc None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.623503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f33adb-571b-4c21-b6b0-a8cf53e6f73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.625222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f33adb-571b-4c21-b6b0-a8cf53e6f73f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.625451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f33adb-571b-4c21-b6b0-a8cf53e6f73f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.625731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f33adb-571b-4c21-b6b0-a8cf53e6f73f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.647141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b2d02-92c8-419a-a0e6-91abc4a5f28c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.650818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f33adb-571b-4c21-b6b0-a8cf53e6f73f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.652884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f33adb-571b-4c21-b6b0-a8cf53e6f73f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-57f33adb-571b-4c21-b6b0-a8cf53e6f73f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:04.692369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:04.693432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:04.694306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:04.694306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:04.694306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:04.694306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:04.694306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 308/620] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:04.699882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f33adb-571b-4c21-b6b0-a8cf53e6f73f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.722700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469927a-c412-432f-be78-891f26e045b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.723506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469927a-c412-432f-be78-891f26e045b8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.723871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469927a-c412-432f-be78-891f26e045b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.724143 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469927a-c412-432f-be78-891f26e045b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.738713 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469927a-c412-432f-be78-891f26e045b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.740292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469927a-c412-432f-be78-891f26e045b8 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-4469927a-c412-432f-be78-891f26e045b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:04.760411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:04.761587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:04.762466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:04.762466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:04.762466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:04.762466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:04.762466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 313/621] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:04.767504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469927a-c412-432f-be78-891f26e045b8 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:04.810069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:04.815832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:04.857119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f33adb-571b-4c21-b6b0-a8cf53e6f73f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.894381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469927a-c412-432f-be78-891f26e045b8 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:04.895263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b3871-15a1-44b8-8b56-dcdc47a90e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.896003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3871-15a1-44b8-8b56-dcdc47a90e7f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.896289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3871-15a1-44b8-8b56-dcdc47a90e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.896569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3871-15a1-44b8-8b56-dcdc47a90e7f None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.897312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3871-15a1-44b8-8b56-dcdc47a90e7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:04.897622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3871-15a1-44b8-8b56-dcdc47a90e7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.898999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3871-15a1-44b8-8b56-dcdc47a90e7f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.912257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 309/622] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:04.913621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713b77e-34c0-433c-a818-1b4c81b1f432 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.913913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713b77e-34c0-433c-a818-1b4c81b1f432 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.914196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713b77e-34c0-433c-a818-1b4c81b1f432 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.915739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 310/623] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:04.920949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feb55f-e169-434d-9807-0201ac8f0bf1 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.921353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feb55f-e169-434d-9807-0201ac8f0bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.921729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feb55f-e169-434d-9807-0201ac8f0bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.936017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8732cee-1cd5-42dc-9093-c4ebc4adda3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:04.936730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8732cee-1cd5-42dc-9093-c4ebc4adda3c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:04.937014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8732cee-1cd5-42dc-9093-c4ebc4adda3c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:04.937291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8732cee-1cd5-42dc-9093-c4ebc4adda3c None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:04.938030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8732cee-1cd5-42dc-9093-c4ebc4adda3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:04.938408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8732cee-1cd5-42dc-9093-c4ebc4adda3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:04.939413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-35feb55f-e169-434d-9807-0201ac8f0bf1 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:04.939744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8732cee-1cd5-42dc-9093-c4ebc4adda3c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:04.940881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-35feb55f-e169-434d-9807-0201ac8f0bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:04.954887 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 314/624] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:04.955759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8732cee-1cd5-42dc-9093-c4ebc4adda3c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.017663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 311/625] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:01:05.018727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35feb55f-e169-434d-9807-0201ac8f0bf1 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.075330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:05.081892 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8732cee-1cd5-42dc-9093-c4ebc4adda3c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.087221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:05.123887 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9acd7-c767-4b16-83bb-1fa901adcffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.124867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9acd7-c767-4b16-83bb-1fa901adcffc None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.125249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9acd7-c767-4b16-83bb-1fa901adcffc None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.125627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9acd7-c767-4b16-83bb-1fa901adcffc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.133871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9acd7-c767-4b16-83bb-1fa901adcffc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.135607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9acd7-c767-4b16-83bb-1fa901adcffc None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.139925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35feb55f-e169-434d-9807-0201ac8f0bf1 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-65d9acd7-c767-4b16-83bb-1fa901adcffc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:05.150666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:05.152414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:05.154064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:05.154064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:05.154064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:05.154064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:05.154064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:05.154064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:05.154064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:05.154064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:05.154064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:01:05.154064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:05.155073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 315/626] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 15:01:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:05.159589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9acd7-c767-4b16-83bb-1fa901adcffc None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.177981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd9862-8964-4805-b4b6-290125a0e9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.179123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd9862-8964-4805-b4b6-290125a0e9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.179670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd9862-8964-4805-b4b6-290125a0e9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.180152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd9862-8964-4805-b4b6-290125a0e9c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.187507 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd9862-8964-4805-b4b6-290125a0e9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.189716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd9862-8964-4805-b4b6-290125a0e9c0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3ddd9862-8964-4805-b4b6-290125a0e9c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:05.204313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:05.205272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:05.206179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:05.206179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:05.206179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:05.206179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:05.206179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:05.206179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:05.206179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:05.206179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:05.213336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 312/627] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:05.214385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd9862-8964-4805-b4b6-290125a0e9c0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.271649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9acd7-c767-4b16-83bb-1fa901adcffc None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.312276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f5d0b-24b4-4453-ac4f-d0a7898cbc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.313777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f5d0b-24b4-4453-ac4f-d0a7898cbc40 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.314246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f5d0b-24b4-4453-ac4f-d0a7898cbc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.314700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f5d0b-24b4-4453-ac4f-d0a7898cbc40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.328690 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f5d0b-24b4-4453-ac4f-d0a7898cbc40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-3d9f5d0b-24b4-4453-ac4f-d0a7898cbc40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:05.339310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:05.340508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:05.341375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:05.341375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:05.341375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:05.341375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:05.341375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:05.341375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:05.341375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:05.341375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:05.341375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:05.341375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:05.341375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:05.341375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:05.342026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd9862-8964-4805-b4b6-290125a0e9c0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.345507 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 316/628] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:01:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:05.346745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f5d0b-24b4-4453-ac4f-d0a7898cbc40 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.366543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:05.371393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:05.396190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf24676-ded3-48da-af0d-72d41f43a911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.396887 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf24676-ded3-48da-af0d-72d41f43a911 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.397175 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf24676-ded3-48da-af0d-72d41f43a911 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.397455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf24676-ded3-48da-af0d-72d41f43a911 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.398320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf24676-ded3-48da-af0d-72d41f43a911 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:05.398632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf24676-ded3-48da-af0d-72d41f43a911 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.400107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf24676-ded3-48da-af0d-72d41f43a911 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.424015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 313/629] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 15:01:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:05.424015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf24676-ded3-48da-af0d-72d41f43a911 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.478191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f5d0b-24b4-4453-ac4f-d0a7898cbc40 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.515518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfb8df-d8b1-498e-840a-126186d4934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.516595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb8df-d8b1-498e-840a-126186d4934c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.517140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb8df-d8b1-498e-840a-126186d4934c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.517616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb8df-d8b1-498e-840a-126186d4934c None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.518785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfb8df-d8b1-498e-840a-126186d4934c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:05.519299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfb8df-d8b1-498e-840a-126186d4934c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.521167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfb8df-d8b1-498e-840a-126186d4934c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.530775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf24676-ded3-48da-af0d-72d41f43a911 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.535984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 317/630] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:05.537179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfb8df-d8b1-498e-840a-126186d4934c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.576799 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10764e-52e9-4b45-9cfc-9f8cc52a0d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.577481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10764e-52e9-4b45-9cfc-9f8cc52a0d8c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.577772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10764e-52e9-4b45-9cfc-9f8cc52a0d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.578058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10764e-52e9-4b45-9cfc-9f8cc52a0d8c None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.578819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10764e-52e9-4b45-9cfc-9f8cc52a0d8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:05.579135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10764e-52e9-4b45-9cfc-9f8cc52a0d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.580544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10764e-52e9-4b45-9cfc-9f8cc52a0d8c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.589627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 314/631] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:01:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:05.590422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10764e-52e9-4b45-9cfc-9f8cc52a0d8c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.625287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:05.628197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:05.653967 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfb8df-d8b1-498e-840a-126186d4934c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.690336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42c955-285b-4795-b0ba-df7495db296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.690918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42c955-285b-4795-b0ba-df7495db296e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.691197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42c955-285b-4795-b0ba-df7495db296e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.691475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42c955-285b-4795-b0ba-df7495db296e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.695282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10764e-52e9-4b45-9cfc-9f8cc52a0d8c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.736688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab8e60-f64e-48e7-a32d-635909bc641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.737749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab8e60-f64e-48e7-a32d-635909bc641a None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.738039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab8e60-f64e-48e7-a32d-635909bc641a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.738324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab8e60-f64e-48e7-a32d-635909bc641a None admin] PATH_INFO: `/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/1643cf33cd3b417bb2cd15b5503f7ffd/roles/4e05103edb314958aba7aa66c8747306` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.755977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab8e60-f64e-48e7-a32d-635909bc641a None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ad2e4552f43f09ebf85b6c82a5481, user_id=1643cf33cd3b417bb2cd15b5503f7ffd, role_id=4e05103edb314958aba7aa66c8747306)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.757460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab8e60-f64e-48e7-a32d-635909bc641a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.769120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42c955-285b-4795-b0ba-df7495db296e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.771014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42c955-285b-4795-b0ba-df7495db296e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:05.772125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 315/632] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:01:05 2022] PUT /identity/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/1643cf33cd3b417bb2cd15b5503f7ffd/roles/4e05103edb314958aba7aa66c8747306 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:05.773533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ccd04-e7f3-445d-8889-7f49d10a2550 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.773828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ccd04-e7f3-445d-8889-7f49d10a2550 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.774110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ccd04-e7f3-445d-8889-7f49d10a2550 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.779766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 316/633] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:05.779766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ccd04-e7f3-445d-8889-7f49d10a2550 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:05.870423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:05.904610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 318/634] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:01:05.904610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b99aa6-b27c-4b81-a8b4-5827cdb79d8f None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.904610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b99aa6-b27c-4b81-a8b4-5827cdb79d8f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.904610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b99aa6-b27c-4b81-a8b4-5827cdb79d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.905384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:05.924222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-37b99aa6-b27c-4b81-a8b4-5827cdb79d8f None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:05.925555 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-37b99aa6-b27c-4b81-a8b4-5827cdb79d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:05.927770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ccd04-e7f3-445d-8889-7f49d10a2550 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:05.967016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae28e44-f60c-45cf-95f6-df0d51630346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:05.967765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae28e44-f60c-45cf-95f6-df0d51630346 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:05.968024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae28e44-f60c-45cf-95f6-df0d51630346 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:05.968329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae28e44-f60c-45cf-95f6-df0d51630346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:05.982854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae28e44-f60c-45cf-95f6-df0d51630346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:05.985791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae28e44-f60c-45cf-95f6-df0d51630346 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-5ae28e44-f60c-45cf-95f6-df0d51630346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:06.005387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:06.006693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:06.007798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:06.007798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:06.007798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:06.007798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:06.008047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 319/635] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:01:06.008047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b99aa6-b27c-4b81-a8b4-5827cdb79d8f None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:06.008177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 317/636] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:06.008244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719ce26-d1a7-4049-8525-5cbfd312f9ad None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:06.010439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719ce26-d1a7-4049-8525-5cbfd312f9ad None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:06.010439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719ce26-d1a7-4049-8525-5cbfd312f9ad None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:06.010439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 318/637] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:06.016380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719ce26-d1a7-4049-8525-5cbfd312f9ad None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:06.112877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b99aa6-b27c-4b81-a8b4-5827cdb79d8f None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:06.120472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:06.124624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719ce26-d1a7-4049-8525-5cbfd312f9ad None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:06.149256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b56dc1-49cc-447e-bbf7-84caf0005761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:06.150067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b56dc1-49cc-447e-bbf7-84caf0005761 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:06.150352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b56dc1-49cc-447e-bbf7-84caf0005761 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:06.150634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b56dc1-49cc-447e-bbf7-84caf0005761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:06.164899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b56dc1-49cc-447e-bbf7-84caf0005761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:06.166398 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b56dc1-49cc-447e-bbf7-84caf0005761 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:06.171112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae3b7e-a00b-4a51-bbfd-304287b91970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:06.171830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3b7e-a00b-4a51-bbfd-304287b91970 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:06.172117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3b7e-a00b-4a51-bbfd-304287b91970 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:06.172393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3b7e-a00b-4a51-bbfd-304287b91970 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:06.173129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae3b7e-a00b-4a51-bbfd-304287b91970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:06.173445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae3b7e-a00b-4a51-bbfd-304287b91970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:06.175257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae3b7e-a00b-4a51-bbfd-304287b91970 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:06.178238 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-e6b56dc1-49cc-447e-bbf7-84caf0005761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:06.184983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:06.185920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:06.186820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:06.186820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:06.186820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:06.186820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:06.194094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 319/638] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:06.194577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 320/639] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:06.194673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9808b4-9ddc-4b90-810a-3dcd5a29e19a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:06.194760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b56dc1-49cc-447e-bbf7-84caf0005761 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:06.194866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9808b4-9ddc-4b90-810a-3dcd5a29e19a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:06.194866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9808b4-9ddc-4b90-810a-3dcd5a29e19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:06.212769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ed9808b4-9ddc-4b90-810a-3dcd5a29e19a None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:06.214805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ed9808b4-9ddc-4b90-810a-3dcd5a29e19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:06.287301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 320/640] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:01:06.291700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9808b4-9ddc-4b90-810a-3dcd5a29e19a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:06.309508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b56dc1-49cc-447e-bbf7-84caf0005761 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:06.349752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf8216-570c-4891-919b-5dfbae2d54d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:06.350826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf8216-570c-4891-919b-5dfbae2d54d1 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:06.351101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf8216-570c-4891-919b-5dfbae2d54d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:06.351379 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf8216-570c-4891-919b-5dfbae2d54d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:06.361666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf8216-570c-4891-919b-5dfbae2d54d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-e3cf8216-570c-4891-919b-5dfbae2d54d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:06.369509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:06.370605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 321/641] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:01:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:06.371796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf8216-570c-4891-919b-5dfbae2d54d1 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:06.390877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:06.397013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9808b4-9ddc-4b90-810a-3dcd5a29e19a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:06.426192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:06.438828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d69e54-ffdb-4bee-9b7d-6ac222d7d898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:06.439605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d69e54-ffdb-4bee-9b7d-6ac222d7d898 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:06.439956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d69e54-ffdb-4bee-9b7d-6ac222d7d898 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:06.440291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d69e54-ffdb-4bee-9b7d-6ac222d7d898 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:06.441089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d69e54-ffdb-4bee-9b7d-6ac222d7d898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:06.441872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d69e54-ffdb-4bee-9b7d-6ac222d7d898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:06.442820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d69e54-ffdb-4bee-9b7d-6ac222d7d898 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:06.458502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 321/642] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:06.459800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d69e54-ffdb-4bee-9b7d-6ac222d7d898 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:06.477287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf8216-570c-4891-919b-5dfbae2d54d1 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:06.512633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45558a3b-7db4-4c3c-82bf-da25858c95cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:06.513442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45558a3b-7db4-4c3c-82bf-da25858c95cf None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:06.513722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45558a3b-7db4-4c3c-82bf-da25858c95cf None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:06.513992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45558a3b-7db4-4c3c-82bf-da25858c95cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:06.522102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45558a3b-7db4-4c3c-82bf-da25858c95cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:06.523542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45558a3b-7db4-4c3c-82bf-da25858c95cf None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-45558a3b-7db4-4c3c-82bf-da25858c95cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:06.537917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:06.538949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:06.539941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:06.539941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:06.539941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:06.539941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:06.539941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:06.539941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:06.539941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:06.539941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:06.539941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 15:01:06.539941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:06.539941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 322/643] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:01:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:06.539941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45558a3b-7db4-4c3c-82bf-da25858c95cf None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:06.577563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d69e54-ffdb-4bee-9b7d-6ac222d7d898 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:06.614466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143702af-a4b4-45f8-abe4-f5955da858c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:06.615512 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143702af-a4b4-45f8-abe4-f5955da858c7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:06.615927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143702af-a4b4-45f8-abe4-f5955da858c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:06.616304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143702af-a4b4-45f8-abe4-f5955da858c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:06.621292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:06.628383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143702af-a4b4-45f8-abe4-f5955da858c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-143702af-a4b4-45f8-abe4-f5955da858c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:06.636367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:06.637477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:06.638581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:06.638581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:06.638581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:06.638581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:06.638581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:06.638581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:06.638581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:06.638581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:06.638581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:06.638581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:06.638581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:06.638581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:06.645412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 322/644] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:01:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:06.645958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45558a3b-7db4-4c3c-82bf-da25858c95cf None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:06.646290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143702af-a4b4-45f8-abe4-f5955da858c7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:06.681986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f9204-4884-4140-bbc9-5270d87085e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:06.682653 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f9204-4884-4140-bbc9-5270d87085e0 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:06.683091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f9204-4884-4140-bbc9-5270d87085e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:06.683624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f9204-4884-4140-bbc9-5270d87085e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:06.685129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f9204-4884-4140-bbc9-5270d87085e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:06.685441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f9204-4884-4140-bbc9-5270d87085e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:06.686813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f9204-4884-4140-bbc9-5270d87085e0 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:06.694982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:06.696578 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 323/645] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:01:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:06.697338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f9204-4884-4140-bbc9-5270d87085e0 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:06.755581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143702af-a4b4-45f8-abe4-f5955da858c7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:06.790707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9497fa2-4309-4632-9aac-109bd593f591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:06.791540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9497fa2-4309-4632-9aac-109bd593f591 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:06.791919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9497fa2-4309-4632-9aac-109bd593f591 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:06.792265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9497fa2-4309-4632-9aac-109bd593f591 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:06.799342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9497fa2-4309-4632-9aac-109bd593f591 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:06.800991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9497fa2-4309-4632-9aac-109bd593f591 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:06.805334 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f9204-4884-4140-bbc9-5270d87085e0 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-f9497fa2-4309-4632-9aac-109bd593f591 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:06.815354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:06.816532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:06.817630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:06.817630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:06.817630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:06.817630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:06.817630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:06.817630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:06.817630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:06.817630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:06.819841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 323/646] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:06.820774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9497fa2-4309-4632-9aac-109bd593f591 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:06.847342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9e8a0-25f0-42dd-88e2-6dab2d0d7868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:06.848282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9e8a0-25f0-42dd-88e2-6dab2d0d7868 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:06.848550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9e8a0-25f0-42dd-88e2-6dab2d0d7868 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:06.848828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9e8a0-25f0-42dd-88e2-6dab2d0d7868 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:06.849936 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9e8a0-25f0-42dd-88e2-6dab2d0d7868 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:06.850248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9e8a0-25f0-42dd-88e2-6dab2d0d7868 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:06.851715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9e8a0-25f0-42dd-88e2-6dab2d0d7868 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:06.862457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:06.871616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 324/647] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 15:01:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:06.876300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9e8a0-25f0-42dd-88e2-6dab2d0d7868 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:06.934170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9497fa2-4309-4632-9aac-109bd593f591 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:06.941551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:06.975093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd89d5b-6237-4011-96bd-a1ff9b445806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:06.975814 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd89d5b-6237-4011-96bd-a1ff9b445806 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:06.976102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd89d5b-6237-4011-96bd-a1ff9b445806 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:06.976379 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd89d5b-6237-4011-96bd-a1ff9b445806 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:06.977151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd89d5b-6237-4011-96bd-a1ff9b445806 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:06.977462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd89d5b-6237-4011-96bd-a1ff9b445806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:06.978848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd89d5b-6237-4011-96bd-a1ff9b445806 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:06.979304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9e8a0-25f0-42dd-88e2-6dab2d0d7868 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:06.987438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 324/648] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:01:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:06.988294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd89d5b-6237-4011-96bd-a1ff9b445806 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:07.019672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500253b-0fc4-47ec-8239-03a4c588de38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:07.020486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500253b-0fc4-47ec-8239-03a4c588de38 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:07.020757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500253b-0fc4-47ec-8239-03a4c588de38 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:07.021037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500253b-0fc4-47ec-8239-03a4c588de38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:07.032103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500253b-0fc4-47ec-8239-03a4c588de38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:07.033550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500253b-0fc4-47ec-8239-03a4c588de38 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-f500253b-0fc4-47ec-8239-03a4c588de38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:07.051773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:07.052727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:07.053679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:07.053679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:07.053679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:07.053679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:07.053679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 325/649] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:07.053679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500253b-0fc4-47ec-8239-03a4c588de38 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:07.098142 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd89d5b-6237-4011-96bd-a1ff9b445806 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:07.106242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:07.132147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc26c53-1604-4f9f-a634-61bcb4a2244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:07.132816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26c53-1604-4f9f-a634-61bcb4a2244b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:07.133104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26c53-1604-4f9f-a634-61bcb4a2244b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:07.133383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26c53-1604-4f9f-a634-61bcb4a2244b None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:07.134181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc26c53-1604-4f9f-a634-61bcb4a2244b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:07.134503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc26c53-1604-4f9f-a634-61bcb4a2244b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:07.135962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc26c53-1604-4f9f-a634-61bcb4a2244b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:07.148026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 325/650] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:07.149001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc26c53-1604-4f9f-a634-61bcb4a2244b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:07.166639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500253b-0fc4-47ec-8239-03a4c588de38 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:07.178636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:07.201255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62d46e-aa09-4703-bea8-a535d2ac61e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:07.201954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62d46e-aa09-4703-bea8-a535d2ac61e0 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:07.202238 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62d46e-aa09-4703-bea8-a535d2ac61e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:07.202520 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62d46e-aa09-4703-bea8-a535d2ac61e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:07.253762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc26c53-1604-4f9f-a634-61bcb4a2244b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:07.278939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62d46e-aa09-4703-bea8-a535d2ac61e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:07.280686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62d46e-aa09-4703-bea8-a535d2ac61e0 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:07.288621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473efdc4-709a-4579-bee3-564dad41e2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:07.289505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473efdc4-709a-4579-bee3-564dad41e2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:07.289797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473efdc4-709a-4579-bee3-564dad41e2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:07.290080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473efdc4-709a-4579-bee3-564dad41e2d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:07.300637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473efdc4-709a-4579-bee3-564dad41e2d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:07.302169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473efdc4-709a-4579-bee3-564dad41e2d3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-473efdc4-709a-4579-bee3-564dad41e2d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:07.319984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:07.321078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:07.326872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:07.326872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:07.326872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:07.326872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:07.326872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 326/651] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:07.326872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473efdc4-709a-4579-bee3-564dad41e2d3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:07.335476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:07.393513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 326/652] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:01:07.393513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62d46e-aa09-4703-bea8-a535d2ac61e0 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:07.409204 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:07.429290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473efdc4-709a-4579-bee3-564dad41e2d3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:07.467847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a525c96-61c6-4ed5-9b6b-f488be4453b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:07.468527 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a525c96-61c6-4ed5-9b6b-f488be4453b3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:07.468813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a525c96-61c6-4ed5-9b6b-f488be4453b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:07.469096 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a525c96-61c6-4ed5-9b6b-f488be4453b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:07.469832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a525c96-61c6-4ed5-9b6b-f488be4453b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:07.470153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a525c96-61c6-4ed5-9b6b-f488be4453b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:07.471533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a525c96-61c6-4ed5-9b6b-f488be4453b3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:07.483819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 327/653] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:07.488890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a525c96-61c6-4ed5-9b6b-f488be4453b3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:07.506305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62d46e-aa09-4703-bea8-a535d2ac61e0 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:07.545634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8458cb-0c8e-4e61-a8ef-399bbf95dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:07.546300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8458cb-0c8e-4e61-a8ef-399bbf95dd72 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:07.546581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8458cb-0c8e-4e61-a8ef-399bbf95dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:07.546853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8458cb-0c8e-4e61-a8ef-399bbf95dd72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:07.547722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8458cb-0c8e-4e61-a8ef-399bbf95dd72 None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=f553cee02ab345dabbef807bfe85544a) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:07.548031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8458cb-0c8e-4e61-a8ef-399bbf95dd72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:07.549568 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8458cb-0c8e-4e61-a8ef-399bbf95dd72 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:07.564252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 327/654] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:07 2022] GET /identity/v3/role_assignments?user.id=f553cee02ab345dabbef807bfe85544a&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:07.565563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8458cb-0c8e-4e61-a8ef-399bbf95dd72 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:07.589142 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:07.610544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a525c96-61c6-4ed5-9b6b-f488be4453b3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:07.651872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3eb3c5-28bf-40b7-ab33-0965f57465c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:07.653268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eb3c5-28bf-40b7-ab33-0965f57465c5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:07.653743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eb3c5-28bf-40b7-ab33-0965f57465c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:07.654196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eb3c5-28bf-40b7-ab33-0965f57465c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:07.655129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3eb3c5-28bf-40b7-ab33-0965f57465c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:07.655754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3eb3c5-28bf-40b7-ab33-0965f57465c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:07.657448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3eb3c5-28bf-40b7-ab33-0965f57465c5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:07.668964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:07.673206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 328/655] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:07.674561 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3eb3c5-28bf-40b7-ab33-0965f57465c5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:07.712725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8458cb-0c8e-4e61-a8ef-399bbf95dd72 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:07.760451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc0ac5-e90d-4025-9470-ffadc4b483ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:07.761779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc0ac5-e90d-4025-9470-ffadc4b483ab None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:07.762282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc0ac5-e90d-4025-9470-ffadc4b483ab None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:07.762803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc0ac5-e90d-4025-9470-ffadc4b483ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:07.779061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc0ac5-e90d-4025-9470-ffadc4b483ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:07.780579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc0ac5-e90d-4025-9470-ffadc4b483ab None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:07.799196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3eb3c5-28bf-40b7-ab33-0965f57465c5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-10bc0ac5-e90d-4025-9470-ffadc4b483ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:07.805132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:07.806049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:07.806942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:07.806942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:07.806942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:07.806942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:07.808193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 328/656] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:07.809373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc0ac5-e90d-4025-9470-ffadc4b483ab None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:07.847340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdc54c-6d3d-409a-8c73-f4ff7239edea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:07.848362 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdc54c-6d3d-409a-8c73-f4ff7239edea None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:07.848648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdc54c-6d3d-409a-8c73-f4ff7239edea None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:07.849373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdc54c-6d3d-409a-8c73-f4ff7239edea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:07.859691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdc54c-6d3d-409a-8c73-f4ff7239edea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:07.861158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdc54c-6d3d-409a-8c73-f4ff7239edea None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c7cdc54c-6d3d-409a-8c73-f4ff7239edea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:07.877306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:07.878300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:07.879996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:07.879996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:07.879996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:07.879996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:07.879996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:07.879996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:07.879996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:07.879996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:07.879996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:01:07.879996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:07.879996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 329/657] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:01:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:07.879996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdc54c-6d3d-409a-8c73-f4ff7239edea None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:07.898597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:07.942659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc0ac5-e90d-4025-9470-ffadc4b483ab None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:07.955025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:07.978502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915e171-296e-4e44-8ff8-304163a3ca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:07.979321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915e171-296e-4e44-8ff8-304163a3ca34 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:07.979648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915e171-296e-4e44-8ff8-304163a3ca34 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:07.979935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915e171-296e-4e44-8ff8-304163a3ca34 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:07.989290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915e171-296e-4e44-8ff8-304163a3ca34 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:07.990895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915e171-296e-4e44-8ff8-304163a3ca34 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-b915e171-296e-4e44-8ff8-304163a3ca34 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:08.005407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:08.006407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:08.007968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:08.007968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:08.007968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:08.007968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:08.007968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:08.007968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:08.007968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:08.007968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:08.007968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:01:08.007968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:08.007968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 329/658] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:01:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:08.007968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915e171-296e-4e44-8ff8-304163a3ca34 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:08.008654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdc54c-6d3d-409a-8c73-f4ff7239edea None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:08.043092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6033f1-7478-4fdd-a5c2-ba557eee9c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:08.043836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6033f1-7478-4fdd-a5c2-ba557eee9c2a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:08.044123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6033f1-7478-4fdd-a5c2-ba557eee9c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:08.044405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6033f1-7478-4fdd-a5c2-ba557eee9c2a None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:08.045144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6033f1-7478-4fdd-a5c2-ba557eee9c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:08.045457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6033f1-7478-4fdd-a5c2-ba557eee9c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:08.046834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6033f1-7478-4fdd-a5c2-ba557eee9c2a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:08.059952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 330/659] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:08.060904 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6033f1-7478-4fdd-a5c2-ba557eee9c2a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:08.122079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915e171-296e-4e44-8ff8-304163a3ca34 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:08.154829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:08.162742 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6033f1-7478-4fdd-a5c2-ba557eee9c2a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:08.164926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c000d54-1fc6-48f3-acf2-94f27e48fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:08.166388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c000d54-1fc6-48f3-acf2-94f27e48fb80 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:08.166675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c000d54-1fc6-48f3-acf2-94f27e48fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:08.167205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c000d54-1fc6-48f3-acf2-94f27e48fb80 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:08.167843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c000d54-1fc6-48f3-acf2-94f27e48fb80 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:08.168159 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c000d54-1fc6-48f3-acf2-94f27e48fb80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:08.169606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c000d54-1fc6-48f3-acf2-94f27e48fb80 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:08.183308 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:08.195873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 330/660] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 15:01:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:08.197271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600530-16f2-4cf6-ba60-c21080e9b66b None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:08.197572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600530-16f2-4cf6-ba60-c21080e9b66b None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:08.197859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600530-16f2-4cf6-ba60-c21080e9b66b None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:08.198660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c68d7-5f86-4207-8980-f726394a6f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:08.199271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 331/661] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:08.199373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c68d7-5f86-4207-8980-f726394a6f5b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:08.199716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c68d7-5f86-4207-8980-f726394a6f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:08.199815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef600530-16f2-4cf6-ba60-c21080e9b66b None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:08.200199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c68d7-5f86-4207-8980-f726394a6f5b None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:08.201045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c68d7-5f86-4207-8980-f726394a6f5b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:08.201357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c68d7-5f86-4207-8980-f726394a6f5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:08.202825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c68d7-5f86-4207-8980-f726394a6f5b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:08.225684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 331/662] 10.222.0.24 () {56 vars in 1139 bytes} [Wed May 25 15:01:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:08.225684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c68d7-5f86-4207-8980-f726394a6f5b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:08.314819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef600530-16f2-4cf6-ba60-c21080e9b66b None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:08.327804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c68d7-5f86-4207-8980-f726394a6f5b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:08.351290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242eaa4e-9086-462e-919b-89c68947bf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:08.352375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eaa4e-9086-462e-919b-89c68947bf09 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:08.352802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eaa4e-9086-462e-919b-89c68947bf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:08.353217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eaa4e-9086-462e-919b-89c68947bf09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:08.360623 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242eaa4e-9086-462e-919b-89c68947bf09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:08.362471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242eaa4e-9086-462e-919b-89c68947bf09 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:08.364994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910878c-97d8-42b6-8bd9-884068cecf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:08.365654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910878c-97d8-42b6-8bd9-884068cecf27 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:08.365969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910878c-97d8-42b6-8bd9-884068cecf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:08.366247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910878c-97d8-42b6-8bd9-884068cecf27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-242eaa4e-9086-462e-919b-89c68947bf09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:08.377668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:08.378688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:08.379754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:08.379754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:08.379754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:08.379754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:08.379754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:08.379754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:08.379754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:08.379754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:08.381548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 332/663] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:08.382941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6c89-ba79-4b88-af79-9a2ef4554744 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:08.383222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6c89-ba79-4b88-af79-9a2ef4554744 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:08.383497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6c89-ba79-4b88-af79-9a2ef4554744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:08.401796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-59cf6c89-ba79-4b88-af79-9a2ef4554744 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:08.403819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-59cf6c89-ba79-4b88-af79-9a2ef4554744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:08.421808 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:08.452258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910878c-97d8-42b6-8bd9-884068cecf27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:08.453806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910878c-97d8-42b6-8bd9-884068cecf27 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:08.454735 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:08.487613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 333/664] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:01:08.487613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf6c89-ba79-4b88-af79-9a2ef4554744 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:08.568934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 332/665] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:01:08.570073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910878c-97d8-42b6-8bd9-884068cecf27 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:08.600534 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf6c89-ba79-4b88-af79-9a2ef4554744 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:08.634722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27ad8c-19ff-4a2d-b90e-e22fa538b638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:08.635301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27ad8c-19ff-4a2d-b90e-e22fa538b638 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:08.635670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27ad8c-19ff-4a2d-b90e-e22fa538b638 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:08.635950 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27ad8c-19ff-4a2d-b90e-e22fa538b638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:08.656326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:08.678830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:08.679226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910878c-97d8-42b6-8bd9-884068cecf27 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:08.708753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27ad8c-19ff-4a2d-b90e-e22fa538b638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:08.710433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27ad8c-19ff-4a2d-b90e-e22fa538b638 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:08.717171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37bfc1-ddbd-4cf4-9674-2450f94e1b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:08.717835 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37bfc1-ddbd-4cf4-9674-2450f94e1b5f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:08.718117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37bfc1-ddbd-4cf4-9674-2450f94e1b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:08.718366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37bfc1-ddbd-4cf4-9674-2450f94e1b5f None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:08.719582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37bfc1-ddbd-4cf4-9674-2450f94e1b5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:08.719933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37bfc1-ddbd-4cf4-9674-2450f94e1b5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:08.721688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37bfc1-ddbd-4cf4-9674-2450f94e1b5f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:08.735661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 333/666] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:08.736616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37bfc1-ddbd-4cf4-9674-2450f94e1b5f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:08.822078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 334/667] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:01:08.823233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27ad8c-19ff-4a2d-b90e-e22fa538b638 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:08.844209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37bfc1-ddbd-4cf4-9674-2450f94e1b5f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:08.879583 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99084f72-3aa3-45c1-af41-f11a6f10a012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:08.880377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99084f72-3aa3-45c1-af41-f11a6f10a012 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:08.880659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99084f72-3aa3-45c1-af41-f11a6f10a012 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:08.880934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99084f72-3aa3-45c1-af41-f11a6f10a012 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:08.888196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:08.893365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99084f72-3aa3-45c1-af41-f11a6f10a012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-99084f72-3aa3-45c1-af41-f11a6f10a012 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:08.901707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:08.902644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:08.903889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 334/668] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:01:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:08.904585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99084f72-3aa3-45c1-af41-f11a6f10a012 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:08.906034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:08.936842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27ad8c-19ff-4a2d-b90e-e22fa538b638 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:08.976906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dbd12-5aef-4767-85da-868fe1ed11e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:08.978015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dbd12-5aef-4767-85da-868fe1ed11e1 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:08.978479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dbd12-5aef-4767-85da-868fe1ed11e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:08.978931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dbd12-5aef-4767-85da-868fe1ed11e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:08.990317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40dbd12-5aef-4767-85da-868fe1ed11e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:08.992609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40dbd12-5aef-4767-85da-868fe1ed11e1 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:09.010047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99084f72-3aa3-45c1-af41-f11a6f10a012 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-d40dbd12-5aef-4767-85da-868fe1ed11e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:09.010208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:09.011073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:09.016724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:09.016724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:09.016724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:09.016724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:09.016724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 335/669] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:09.016724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dbd12-5aef-4767-85da-868fe1ed11e1 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:09.052814 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec8d2d-3932-44aa-b542-5ad79462495c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:09.053474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec8d2d-3932-44aa-b542-5ad79462495c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:09.053812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec8d2d-3932-44aa-b542-5ad79462495c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:09.054091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec8d2d-3932-44aa-b542-5ad79462495c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:09.054927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec8d2d-3932-44aa-b542-5ad79462495c None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=79f0aa2ddbcb494f8a5a53399793aa2e) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:09.055241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec8d2d-3932-44aa-b542-5ad79462495c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:09.056712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec8d2d-3932-44aa-b542-5ad79462495c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:09.071601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 335/670] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:08 2022] GET /identity/v3/role_assignments?user.id=79f0aa2ddbcb494f8a5a53399793aa2e&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:09.071601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec8d2d-3932-44aa-b542-5ad79462495c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:09.133227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dbd12-5aef-4767-85da-868fe1ed11e1 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:09.138700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:09.164655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:09.175158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01214e82-42ae-41bb-9518-b831945c4a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:09.176913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01214e82-42ae-41bb-9518-b831945c4a70 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:09.177345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01214e82-42ae-41bb-9518-b831945c4a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:09.177774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01214e82-42ae-41bb-9518-b831945c4a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:09.187744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec8d2d-3932-44aa-b542-5ad79462495c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:09.194289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01214e82-42ae-41bb-9518-b831945c4a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:09.196081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01214e82-42ae-41bb-9518-b831945c4a70 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-01214e82-42ae-41bb-9518-b831945c4a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:09.222088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:09.223112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:09.224062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:09.224062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:09.224062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:09.224062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:09.228449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 336/671] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:09.229535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01214e82-42ae-41bb-9518-b831945c4a70 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:09.230001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3547c7-e347-4541-b1f8-5704300373e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:09.231092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3547c7-e347-4541-b1f8-5704300373e0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:09.231655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3547c7-e347-4541-b1f8-5704300373e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:09.232135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3547c7-e347-4541-b1f8-5704300373e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:09.233216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3547c7-e347-4541-b1f8-5704300373e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:09.233729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3547c7-e347-4541-b1f8-5704300373e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:09.235354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3547c7-e347-4541-b1f8-5704300373e0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:09.245715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 336/672] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:01:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:09.247113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3547c7-e347-4541-b1f8-5704300373e0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:09.364017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01214e82-42ae-41bb-9518-b831945c4a70 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:09.372982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3547c7-e347-4541-b1f8-5704300373e0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:09.402922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:09.408543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fd11e-369d-4f4a-a42b-999fb5b0ffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:09.409227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fd11e-369d-4f4a-a42b-999fb5b0ffe9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:09.409516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fd11e-369d-4f4a-a42b-999fb5b0ffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:09.409797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fd11e-369d-4f4a-a42b-999fb5b0ffe9 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:09.410540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fd11e-369d-4f4a-a42b-999fb5b0ffe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:09.410852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fd11e-369d-4f4a-a42b-999fb5b0ffe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:09.412279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fd11e-369d-4f4a-a42b-999fb5b0ffe9 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:09.422961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f17c62-a2e3-41ac-b141-21fda5f5efcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:09.424177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f17c62-a2e3-41ac-b141-21fda5f5efcb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:09.424645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f17c62-a2e3-41ac-b141-21fda5f5efcb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:09.425098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f17c62-a2e3-41ac-b141-21fda5f5efcb None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:09.425743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 337/673] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:09.426229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f17c62-a2e3-41ac-b141-21fda5f5efcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:09.426724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fd11e-369d-4f4a-a42b-999fb5b0ffe9 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:09.426832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f17c62-a2e3-41ac-b141-21fda5f5efcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:09.428640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f17c62-a2e3-41ac-b141-21fda5f5efcb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:09.452973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 337/674] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:09.454418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f17c62-a2e3-41ac-b141-21fda5f5efcb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:09.483466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:09.556011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fd11e-369d-4f4a-a42b-999fb5b0ffe9 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:09.584283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f17c62-a2e3-41ac-b141-21fda5f5efcb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:09.598289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803726ed-132d-4c88-8ced-a7598ccb3d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:09.599101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803726ed-132d-4c88-8ced-a7598ccb3d9a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:09.599388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803726ed-132d-4c88-8ced-a7598ccb3d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:09.599718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803726ed-132d-4c88-8ced-a7598ccb3d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:09.612291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803726ed-132d-4c88-8ced-a7598ccb3d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:09.613951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803726ed-132d-4c88-8ced-a7598ccb3d9a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:09.627530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a06ba-2eae-4814-ab18-b61ff9d00859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:09.628737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a06ba-2eae-4814-ab18-b61ff9d00859 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:09.629226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a06ba-2eae-4814-ab18-b61ff9d00859 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:09.629703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a06ba-2eae-4814-ab18-b61ff9d00859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-803726ed-132d-4c88-8ced-a7598ccb3d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:09.631576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:09.632670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:09.633617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:09.633617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:09.633617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:09.633617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:09.637619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 338/675] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:09.638512 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803726ed-132d-4c88-8ced-a7598ccb3d9a None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:09.641410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a06ba-2eae-4814-ab18-b61ff9d00859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:09.644175 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a06ba-2eae-4814-ab18-b61ff9d00859 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-d83a06ba-2eae-4814-ab18-b61ff9d00859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:09.663519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:09.664478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:09.665399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:09.665399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:09.665399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:09.665399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:09.665399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:09.665399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:09.665399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:09.665399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:09.672407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 338/676] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:09.672540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a06ba-2eae-4814-ab18-b61ff9d00859 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:09.740791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:09.746294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:09.759430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803726ed-132d-4c88-8ced-a7598ccb3d9a None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:09.795299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2000e0-f359-4004-b1b0-1952eabd7c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:09.796132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2000e0-f359-4004-b1b0-1952eabd7c28 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:09.796458 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2000e0-f359-4004-b1b0-1952eabd7c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:09.796738 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2000e0-f359-4004-b1b0-1952eabd7c28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:09.803912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2000e0-f359-4004-b1b0-1952eabd7c28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:09.805442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2000e0-f359-4004-b1b0-1952eabd7c28 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:09.816446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a06ba-2eae-4814-ab18-b61ff9d00859 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-4a2000e0-f359-4004-b1b0-1952eabd7c28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:09.819994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:09.821055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:09.822107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:09.822107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:09.822107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:09.822107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:09.822107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:09.822107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:09.822107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:09.822107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:09.822107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 339/677] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:09.822611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2000e0-f359-4004-b1b0-1952eabd7c28 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:09.866746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b2a02-0ec9-496f-884a-f6313c0084a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:09.867414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b2a02-0ec9-496f-884a-f6313c0084a5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:09.867749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b2a02-0ec9-496f-884a-f6313c0084a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:09.868027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b2a02-0ec9-496f-884a-f6313c0084a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:09.868764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b2a02-0ec9-496f-884a-f6313c0084a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:09.869073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b2a02-0ec9-496f-884a-f6313c0084a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:09.870551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b2a02-0ec9-496f-884a-f6313c0084a5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:09.883440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 339/678] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:09.884449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b2a02-0ec9-496f-884a-f6313c0084a5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:09.937169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2000e0-f359-4004-b1b0-1952eabd7c28 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:09.971471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d84ff-a035-4427-b709-dea5a393de1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:09.972183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d84ff-a035-4427-b709-dea5a393de1b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:09.972472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d84ff-a035-4427-b709-dea5a393de1b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:09.972753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d84ff-a035-4427-b709-dea5a393de1b None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:09.973563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d84ff-a035-4427-b709-dea5a393de1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:09.973877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d84ff-a035-4427-b709-dea5a393de1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:09.975322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d84ff-a035-4427-b709-dea5a393de1b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:09.987709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 340/679] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:09.988530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d84ff-a035-4427-b709-dea5a393de1b None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:10.000492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b2a02-0ec9-496f-884a-f6313c0084a5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:10.002591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:10.005480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:10.040926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8eefd-bc52-4853-bb1f-92ab5d63023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:10.042020 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8eefd-bc52-4853-bb1f-92ab5d63023c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:10.042494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8eefd-bc52-4853-bb1f-92ab5d63023c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:10.042989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8eefd-bc52-4853-bb1f-92ab5d63023c None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:10.043984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8eefd-bc52-4853-bb1f-92ab5d63023c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:10.044722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8eefd-bc52-4853-bb1f-92ab5d63023c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:10.046460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8eefd-bc52-4853-bb1f-92ab5d63023c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:10.058634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 340/680] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:10.060029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d633f-3afe-4d7c-b913-66fb7491511e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:10.060324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d633f-3afe-4d7c-b913-66fb7491511e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:10.060607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d633f-3afe-4d7c-b913-66fb7491511e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:10.065717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 341/681] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:10.065717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d633f-3afe-4d7c-b913-66fb7491511e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:10.104163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d84ff-a035-4427-b709-dea5a393de1b None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:10.138460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a06c45-bd77-4a3a-96b8-09babdc6c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:10.139466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06c45-bd77-4a3a-96b8-09babdc6c2fd None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:10.139944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06c45-bd77-4a3a-96b8-09babdc6c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:10.140751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06c45-bd77-4a3a-96b8-09babdc6c2fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:10.149129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a06c45-bd77-4a3a-96b8-09babdc6c2fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:10.150673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a06c45-bd77-4a3a-96b8-09babdc6c2fd None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-22a06c45-bd77-4a3a-96b8-09babdc6c2fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:10.164930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:10.165966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:10.166902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:10.166902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:10.166902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:10.166902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:10.166902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:10.166902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:10.166902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:10.166902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:10.166902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 15:01:10.166902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:10.166902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 341/682] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:01:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:10.166902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a06c45-bd77-4a3a-96b8-09babdc6c2fd None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:10.173280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d633f-3afe-4d7c-b913-66fb7491511e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:10.219183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec7b3a-1a3e-4e61-99b6-281d5b2d292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:10.219792 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec7b3a-1a3e-4e61-99b6-281d5b2d292c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:10.220081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec7b3a-1a3e-4e61-99b6-281d5b2d292c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:10.220366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec7b3a-1a3e-4e61-99b6-281d5b2d292c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:10.221216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec7b3a-1a3e-4e61-99b6-281d5b2d292c None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=49e5814865044696a7d0021d44629604) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:10.221538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec7b3a-1a3e-4e61-99b6-281d5b2d292c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:10.222978 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec7b3a-1a3e-4e61-99b6-281d5b2d292c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:10.229304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 342/683] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:10 2022] GET /identity/v3/role_assignments?user.id=49e5814865044696a7d0021d44629604&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:10.230642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1547a0c-0bac-4508-a055-9e4078f07e3f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:10.230936 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1547a0c-0bac-4508-a055-9e4078f07e3f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:10.231363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1547a0c-0bac-4508-a055-9e4078f07e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:10.254449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b1547a0c-0bac-4508-a055-9e4078f07e3f None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:10.255202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:10.258621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b1547a0c-0bac-4508-a055-9e4078f07e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:10.287851 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:10.297430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a06c45-bd77-4a3a-96b8-09babdc6c2fd None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:10.337620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1e424-5746-4ca3-be4d-af181997108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:10.338773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1e424-5746-4ca3-be4d-af181997108c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:10.339241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1e424-5746-4ca3-be4d-af181997108c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:10.339756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1e424-5746-4ca3-be4d-af181997108c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:10.339969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 343/684] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:01:10.340813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1547a0c-0bac-4508-a055-9e4078f07e3f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:10.341335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1e424-5746-4ca3-be4d-af181997108c None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=d4b24eb13be7443f9c24e55532ef95d3) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:10.341860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1e424-5746-4ca3-be4d-af181997108c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:10.343689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1e424-5746-4ca3-be4d-af181997108c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:10.359717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 342/685] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:10 2022] GET /identity/v3/role_assignments?user.id=d4b24eb13be7443f9c24e55532ef95d3&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:10.391360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1e424-5746-4ca3-be4d-af181997108c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:10.516176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1547a0c-0bac-4508-a055-9e4078f07e3f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:10.565410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a1240-7ccc-43a1-bc00-f367c434eaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:10.566103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a1240-7ccc-43a1-bc00-f367c434eaae None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:10.566378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a1240-7ccc-43a1-bc00-f367c434eaae None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:10.566651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a1240-7ccc-43a1-bc00-f367c434eaae None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:10.567508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a1240-7ccc-43a1-bc00-f367c434eaae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:10.567844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a1240-7ccc-43a1-bc00-f367c434eaae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:10.569276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a1240-7ccc-43a1-bc00-f367c434eaae None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:10.579715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1e424-5746-4ca3-be4d-af181997108c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:10.598760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 344/686] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 15:01:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:10.603087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a1240-7ccc-43a1-bc00-f367c434eaae None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:10.622800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:10.629859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f2b36-9952-479e-8276-de4e60080826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:10.630676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f2b36-9952-479e-8276-de4e60080826 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:10.630970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f2b36-9952-479e-8276-de4e60080826 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:10.631249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f2b36-9952-479e-8276-de4e60080826 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:10.633801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:10.647876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f2b36-9952-479e-8276-de4e60080826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-f21f2b36-9952-479e-8276-de4e60080826 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:10.661959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:10.662964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:10.663969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 343/687] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:01:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:10.671345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f2b36-9952-479e-8276-de4e60080826 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:10.729028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a1240-7ccc-43a1-bc00-f367c434eaae None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:10.768634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab719e-380f-4680-8e39-6e17dcc544fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:10.769225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab719e-380f-4680-8e39-6e17dcc544fa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:10.769508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab719e-380f-4680-8e39-6e17dcc544fa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:10.769786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab719e-380f-4680-8e39-6e17dcc544fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:10.852091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab719e-380f-4680-8e39-6e17dcc544fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:10.853825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab719e-380f-4680-8e39-6e17dcc544fa None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:10.874265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:10.947732 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f2b36-9952-479e-8276-de4e60080826 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:10.966437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 345/688] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:01:10.972306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab719e-380f-4680-8e39-6e17dcc544fa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:11.033036 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888ff2f-202f-4ccd-ae0f-5e52e219868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:11.033818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888ff2f-202f-4ccd-ae0f-5e52e219868a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:11.034107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888ff2f-202f-4ccd-ae0f-5e52e219868a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:11.034382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888ff2f-202f-4ccd-ae0f-5e52e219868a None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:11.035179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888ff2f-202f-4ccd-ae0f-5e52e219868a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:11.035576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888ff2f-202f-4ccd-ae0f-5e52e219868a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:11.037094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888ff2f-202f-4ccd-ae0f-5e52e219868a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:11.064747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 344/689] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:01:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:11.071780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888ff2f-202f-4ccd-ae0f-5e52e219868a None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:11.083762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab719e-380f-4680-8e39-6e17dcc544fa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:11.102051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:11.121468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a40c2-00f6-41e8-95ec-ca5cfdd33342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:11.122731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a40c2-00f6-41e8-95ec-ca5cfdd33342 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:11.123292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a40c2-00f6-41e8-95ec-ca5cfdd33342 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:11.123613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a40c2-00f6-41e8-95ec-ca5cfdd33342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:11.135303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a40c2-00f6-41e8-95ec-ca5cfdd33342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:11.137016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a40c2-00f6-41e8-95ec-ca5cfdd33342 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ac1a40c2-00f6-41e8-95ec-ca5cfdd33342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:11.157864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:11.158852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:11.159829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:11.159829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:11.159829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:11.159829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:11.159829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 346/690] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:11.167510 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a40c2-00f6-41e8-95ec-ca5cfdd33342 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:11.199123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:11.273730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888ff2f-202f-4ccd-ae0f-5e52e219868a None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:11.333372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653310d-20c4-407b-93f3-f0caec2e7d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:11.334098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653310d-20c4-407b-93f3-f0caec2e7d94 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:11.334385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653310d-20c4-407b-93f3-f0caec2e7d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:11.334661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653310d-20c4-407b-93f3-f0caec2e7d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:11.347504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a40c2-00f6-41e8-95ec-ca5cfdd33342 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:11.357026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653310d-20c4-407b-93f3-f0caec2e7d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:11.358501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653310d-20c4-407b-93f3-f0caec2e7d94 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-f653310d-20c4-407b-93f3-f0caec2e7d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:11.383290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:11.384331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:11.385314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:11.385314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:11.385314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:11.385314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:11.385314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 345/691] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:11.390668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653310d-20c4-407b-93f3-f0caec2e7d94 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:11.415769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fc1ea-2d83-4b60-8c22-f5b9266a409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:11.416450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fc1ea-2d83-4b60-8c22-f5b9266a409d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:11.416734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fc1ea-2d83-4b60-8c22-f5b9266a409d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:11.417009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fc1ea-2d83-4b60-8c22-f5b9266a409d None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:11.417747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fc1ea-2d83-4b60-8c22-f5b9266a409d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:11.418106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fc1ea-2d83-4b60-8c22-f5b9266a409d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:11.419486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fc1ea-2d83-4b60-8c22-f5b9266a409d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:11.444527 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 347/692] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:11.450649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fc1ea-2d83-4b60-8c22-f5b9266a409d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:11.504626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:11.569342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653310d-20c4-407b-93f3-f0caec2e7d94 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:11.593737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:11.613565 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fc1ea-2d83-4b60-8c22-f5b9266a409d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:11.641734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe709e3-d80a-47c9-9980-485927494088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:11.643495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe709e3-d80a-47c9-9980-485927494088 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:11.643806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe709e3-d80a-47c9-9980-485927494088 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:11.645132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe709e3-d80a-47c9-9980-485927494088 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:11.645883 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe709e3-d80a-47c9-9980-485927494088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:11.646195 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe709e3-d80a-47c9-9980-485927494088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:11.647612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe709e3-d80a-47c9-9980-485927494088 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:11.673550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 346/693] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:11.679243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe709e3-d80a-47c9-9980-485927494088 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:11.681671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdbbd3-e1b0-4b24-a2d4-c92228487447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:11.682814 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdbbd3-e1b0-4b24-a2d4-c92228487447 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:11.683303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdbbd3-e1b0-4b24-a2d4-c92228487447 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:11.683856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdbbd3-e1b0-4b24-a2d4-c92228487447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:11.692082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdbbd3-e1b0-4b24-a2d4-c92228487447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:11.693812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdbbd3-e1b0-4b24-a2d4-c92228487447 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-fcfdbbd3-e1b0-4b24-a2d4-c92228487447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:11.709289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:11.710260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:11.711254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:11.711254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:11.711254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:11.711254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:11.711254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:11.711254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:11.711254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:11.711254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:11.713758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 348/694] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:11.715321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333f547-2f32-4a35-bc9d-9ab223468b55 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:11.715837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333f547-2f32-4a35-bc9d-9ab223468b55 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:11.716312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333f547-2f32-4a35-bc9d-9ab223468b55 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:11.717795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 349/695] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:11.722727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333f547-2f32-4a35-bc9d-9ab223468b55 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:11.788906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe709e3-d80a-47c9-9980-485927494088 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:11.818316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:11.825301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d88611-16d9-4c0d-b004-9330c53515a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:11.826125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d88611-16d9-4c0d-b004-9330c53515a8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:11.826408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d88611-16d9-4c0d-b004-9330c53515a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:11.826688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d88611-16d9-4c0d-b004-9330c53515a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:11.834202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333f547-2f32-4a35-bc9d-9ab223468b55 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:11.835016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d88611-16d9-4c0d-b004-9330c53515a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:11.836664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d88611-16d9-4c0d-b004-9330c53515a8 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-04d88611-16d9-4c0d-b004-9330c53515a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:11.851407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:11.852615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:11.853574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:11.853574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:11.853574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:11.853574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:11.853574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:11.853574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:11.853574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:11.853574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:11.853574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:01:11.853574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:11.857245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 347/696] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 15:01:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:11.858579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd1363-bf9f-4cac-be17-61a10e4560d7 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:11.858870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd1363-bf9f-4cac-be17-61a10e4560d7 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:11.859149 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd1363-bf9f-4cac-be17-61a10e4560d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:11.875619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe4ddc-bac8-4337-b730-15cf9031c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:11.876457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-2dbd1363-bf9f-4cac-be17-61a10e4560d7 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:11.876857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe4ddc-bac8-4337-b730-15cf9031c79f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:11.877387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe4ddc-bac8-4337-b730-15cf9031c79f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:11.877656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-2dbd1363-bf9f-4cac-be17-61a10e4560d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:11.878103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe4ddc-bac8-4337-b730-15cf9031c79f None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:11.879131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe4ddc-bac8-4337-b730-15cf9031c79f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:11.879706 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe4ddc-bac8-4337-b730-15cf9031c79f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:11.881428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe4ddc-bac8-4337-b730-15cf9031c79f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:11.894544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 350/697] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:11.895786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe4ddc-bac8-4337-b730-15cf9031c79f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:11.902177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:11.955584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 348/698] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:01:11.955584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd1363-bf9f-4cac-be17-61a10e4560d7 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:12.006607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe4ddc-bac8-4337-b730-15cf9031c79f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:12.042220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea99c7-b193-450a-95af-a81c999a4f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:12.043413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea99c7-b193-450a-95af-a81c999a4f97 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.043951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea99c7-b193-450a-95af-a81c999a4f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.044447 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea99c7-b193-450a-95af-a81c999a4f97 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.045596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea99c7-b193-450a-95af-a81c999a4f97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:12.046108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea99c7-b193-450a-95af-a81c999a4f97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:12.047811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea99c7-b193-450a-95af-a81c999a4f97 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:12.052040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd1363-bf9f-4cac-be17-61a10e4560d7 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:12.066960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 351/699] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 15:01:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:12.068079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea99c7-b193-450a-95af-a81c999a4f97 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:12.081313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:12.096951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0fe84-4042-47ae-96e6-09589eca4ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:12.097911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0fe84-4042-47ae-96e6-09589eca4ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.098909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0fe84-4042-47ae-96e6-09589eca4ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.099388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0fe84-4042-47ae-96e6-09589eca4ad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.100543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0fe84-4042-47ae-96e6-09589eca4ad8 None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=1643cf33cd3b417bb2cd15b5503f7ffd) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:12.100870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0fe84-4042-47ae-96e6-09589eca4ad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:12.102434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0fe84-4042-47ae-96e6-09589eca4ad8 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:12.108724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 349/700] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:11 2022] GET /identity/v3/role_assignments?user.id=1643cf33cd3b417bb2cd15b5503f7ffd&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:12.109532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0fe84-4042-47ae-96e6-09589eca4ad8 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:12.135251 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:12.193068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea99c7-b193-450a-95af-a81c999a4f97 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:12.215256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0fe84-4042-47ae-96e6-09589eca4ad8 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:12.232725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838479a3-499e-4e57-a43b-ac3545fed4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:12.234546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838479a3-499e-4e57-a43b-ac3545fed4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.235059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838479a3-499e-4e57-a43b-ac3545fed4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.235531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838479a3-499e-4e57-a43b-ac3545fed4c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.250997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838479a3-499e-4e57-a43b-ac3545fed4c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:12.252354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2ebef-3014-49f6-94c8-3cc36decf7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:12.253027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2ebef-3014-49f6-94c8-3cc36decf7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.253315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2ebef-3014-49f6-94c8-3cc36decf7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.253597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2ebef-3014-49f6-94c8-3cc36decf7e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.253789 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838479a3-499e-4e57-a43b-ac3545fed4c9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-838479a3-499e-4e57-a43b-ac3545fed4c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:12.278223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:12.279193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:12.280525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:12.280525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:12.280525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:12.280525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:12.283060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 352/701] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:12.288481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838479a3-499e-4e57-a43b-ac3545fed4c9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:12.385070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:12.409115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2ebef-3014-49f6-94c8-3cc36decf7e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:12.412004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2ebef-3014-49f6-94c8-3cc36decf7e5 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:12.435729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838479a3-499e-4e57-a43b-ac3545fed4c9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:12.443960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:12.483286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69445e7f-0769-46be-b4eb-91acab8f96a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:12.484344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69445e7f-0769-46be-b4eb-91acab8f96a7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.484844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69445e7f-0769-46be-b4eb-91acab8f96a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.485125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69445e7f-0769-46be-b4eb-91acab8f96a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.485867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69445e7f-0769-46be-b4eb-91acab8f96a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:12.486178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69445e7f-0769-46be-b4eb-91acab8f96a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:12.487583 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69445e7f-0769-46be-b4eb-91acab8f96a7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:12.507736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 353/702] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:12.509347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69445e7f-0769-46be-b4eb-91acab8f96a7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:12.560374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 350/703] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:01:12.565635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2ebef-3014-49f6-94c8-3cc36decf7e5 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:12.648825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69445e7f-0769-46be-b4eb-91acab8f96a7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:12.670466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:12.677462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2ebef-3014-49f6-94c8-3cc36decf7e5 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:12.696452 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3b325-8f10-44a5-89fa-4cea8640975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:12.697156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3b325-8f10-44a5-89fa-4cea8640975a None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.697444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3b325-8f10-44a5-89fa-4cea8640975a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.697733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3b325-8f10-44a5-89fa-4cea8640975a None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.698461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3b325-8f10-44a5-89fa-4cea8640975a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:12.700064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3b325-8f10-44a5-89fa-4cea8640975a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:12.701769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:12.717190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce79b1-9f9c-41f6-a96a-3423ffa60990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:12.718003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce79b1-9f9c-41f6-a96a-3423ffa60990 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.718286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce79b1-9f9c-41f6-a96a-3423ffa60990 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.718563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce79b1-9f9c-41f6-a96a-3423ffa60990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.732864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 354/704] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:01:12 2022] POST /identity/v3/users => generated 254 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:12.740289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce79b1-9f9c-41f6-a96a-3423ffa60990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:12.741788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce79b1-9f9c-41f6-a96a-3423ffa60990 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-6fce79b1-9f9c-41f6-a96a-3423ffa60990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:12.776767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:12.777750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:12.778643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:12.778643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:12.778643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:12.778643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:12.783793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 351/705] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:12.789666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3b325-8f10-44a5-89fa-4cea8640975a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:12.930242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3b325-8f10-44a5-89fa-4cea8640975a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:12.969157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287973ba-79e6-4ee9-ad98-a0d0c848511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:12.969843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287973ba-79e6-4ee9-ad98-a0d0c848511f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:12.970174 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287973ba-79e6-4ee9-ad98-a0d0c848511f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:12.970462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287973ba-79e6-4ee9-ad98-a0d0c848511f None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:12.971218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287973ba-79e6-4ee9-ad98-a0d0c848511f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:12.971588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287973ba-79e6-4ee9-ad98-a0d0c848511f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:12.972981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287973ba-79e6-4ee9-ad98-a0d0c848511f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:12.986571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 355/706] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:12.991618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce79b1-9f9c-41f6-a96a-3423ffa60990 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.003406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cd0ae-12fe-48a8-9a33-11ffca53cc68 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.004050 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cd0ae-12fe-48a8-9a33-11ffca53cc68 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.004531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cd0ae-12fe-48a8-9a33-11ffca53cc68 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.006338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 356/707] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:13.011776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b1b9a-6576-47b2-a677-d622feedae82 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.012365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b1b9a-6576-47b2-a677-d622feedae82 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.012845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b1b9a-6576-47b2-a677-d622feedae82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.034895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c23b1b9a-6576-47b2-a677-d622feedae82 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:13.036134 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c23b1b9a-6576-47b2-a677-d622feedae82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:13.070287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:13.119765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce79b1-9f9c-41f6-a96a-3423ffa60990 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.126152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 357/708] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:01:13.149637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102800-240e-45b5-97ba-a22de817ed4a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.150266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102800-240e-45b5-97ba-a22de817ed4a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.150760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102800-240e-45b5-97ba-a22de817ed4a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.153202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 358/709] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:13.153202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b102800-240e-45b5-97ba-a22de817ed4a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.168679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238bd80-5186-4cdf-843a-f9e2331b0e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.169969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238bd80-5186-4cdf-843a-f9e2331b0e8c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.170261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238bd80-5186-4cdf-843a-f9e2331b0e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.170544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238bd80-5186-4cdf-843a-f9e2331b0e8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.180016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238bd80-5186-4cdf-843a-f9e2331b0e8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.181886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238bd80-5186-4cdf-843a-f9e2331b0e8c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-3238bd80-5186-4cdf-843a-f9e2331b0e8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:13.200040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:13.200999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:13.201897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:13.201897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:13.201897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:13.201897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:13.201897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:13.201897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:13.201897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:13.201897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:13.204753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 352/710] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:13.205790 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d961635-5299-4034-ba96-1738437e627c None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.206075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d961635-5299-4034-ba96-1738437e627c None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.206357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d961635-5299-4034-ba96-1738437e627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.232745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-2d961635-5299-4034-ba96-1738437e627c None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:13.235144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-2d961635-5299-4034-ba96-1738437e627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:13.272375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b102800-240e-45b5-97ba-a22de817ed4a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.276974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:13.311737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f155742-6cc0-4cdf-bef1-caa214d733d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.312708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f155742-6cc0-4cdf-bef1-caa214d733d4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.312995 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f155742-6cc0-4cdf-bef1-caa214d733d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.313317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f155742-6cc0-4cdf-bef1-caa214d733d4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.314220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f155742-6cc0-4cdf-bef1-caa214d733d4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.315494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f155742-6cc0-4cdf-bef1-caa214d733d4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-7f155742-6cc0-4cdf-bef1-caa214d733d4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:13.330692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:13.331749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:01:13.332607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:13.335896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 353/712] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:01:13.337068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d961635-5299-4034-ba96-1738437e627c None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.339543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 359/712] 10.222.0.24 () {56 vars in 1129 bytes} [Wed May 25 15:01:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:13.342917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f155742-6cc0-4cdf-bef1-caa214d733d4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.389672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:13.474883 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d961635-5299-4034-ba96-1738437e627c None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.478824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f155742-6cc0-4cdf-bef1-caa214d733d4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.516937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd0ec0-8869-4391-900f-2d0874bcf12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.517961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd0ec0-8869-4391-900f-2d0874bcf12c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.518444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd0ec0-8869-4391-900f-2d0874bcf12c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.519011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd0ec0-8869-4391-900f-2d0874bcf12c None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.520027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd0ec0-8869-4391-900f-2d0874bcf12c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:13.520579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd0ec0-8869-4391-900f-2d0874bcf12c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.522152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd0ec0-8869-4391-900f-2d0874bcf12c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.531589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33fd91-9345-4e3f-a908-92d3411f6058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.531589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33fd91-9345-4e3f-a908-92d3411f6058 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.531589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33fd91-9345-4e3f-a908-92d3411f6058 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.531589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33fd91-9345-4e3f-a908-92d3411f6058 None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.531959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33fd91-9345-4e3f-a908-92d3411f6058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:13.531959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33fd91-9345-4e3f-a908-92d3411f6058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.532570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 360/713] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 15:01:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:13.533625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd0ec0-8869-4391-900f-2d0874bcf12c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.534451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33fd91-9345-4e3f-a908-92d3411f6058 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.557210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 354/714] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:13.558359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33fd91-9345-4e3f-a908-92d3411f6058 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.586696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:13.664147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33fd91-9345-4e3f-a908-92d3411f6058 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.686291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:13.700483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a87fd-404c-428e-b71e-976907b9fd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.701297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a87fd-404c-428e-b71e-976907b9fd38 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.701681 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a87fd-404c-428e-b71e-976907b9fd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.702052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a87fd-404c-428e-b71e-976907b9fd38 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.702949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a87fd-404c-428e-b71e-976907b9fd38 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:13.703280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a87fd-404c-428e-b71e-976907b9fd38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.704137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd0ec0-8869-4391-900f-2d0874bcf12c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.704907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a87fd-404c-428e-b71e-976907b9fd38 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.716005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 355/715] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 15:01:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:13.717113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a87fd-404c-428e-b71e-976907b9fd38 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.770683 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d25d5-488e-40c4-ba9b-94dce9be61a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.772568 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d25d5-488e-40c4-ba9b-94dce9be61a1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.773410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d25d5-488e-40c4-ba9b-94dce9be61a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.774132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d25d5-488e-40c4-ba9b-94dce9be61a1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.775740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d25d5-488e-40c4-ba9b-94dce9be61a1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.778476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d25d5-488e-40c4-ba9b-94dce9be61a1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ae8d25d5-488e-40c4-ba9b-94dce9be61a1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:13.802871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:13.804776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:01:13.806318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:13.811227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 361/716] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:13 2022] GET /identity/v3/services/network => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:13.830127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d25d5-488e-40c4-ba9b-94dce9be61a1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:13.865376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:13.878819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a87fd-404c-428e-b71e-976907b9fd38 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:13.916023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cf55b-cd12-4ed2-8db0-715b82989ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:13.916990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cf55b-cd12-4ed2-8db0-715b82989ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:13.917460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cf55b-cd12-4ed2-8db0-715b82989ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:13.917915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cf55b-cd12-4ed2-8db0-715b82989ad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:13.918947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cf55b-cd12-4ed2-8db0-715b82989ad7 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=f553cee02ab345dabbef807bfe85544a) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:13.919465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cf55b-cd12-4ed2-8db0-715b82989ad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:13.921390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cf55b-cd12-4ed2-8db0-715b82989ad7 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:13.928267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 356/717] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:13 2022] GET /identity/v3/role_assignments?user.id=f553cee02ab345dabbef807bfe85544a&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:14.009318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d25d5-488e-40c4-ba9b-94dce9be61a1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:14.063588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f93ee-65c4-4112-97e8-b247c2730763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:14.064611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f93ee-65c4-4112-97e8-b247c2730763 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:14.065040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f93ee-65c4-4112-97e8-b247c2730763 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:14.065461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f93ee-65c4-4112-97e8-b247c2730763 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:14.066556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f93ee-65c4-4112-97e8-b247c2730763 None admin] RBAC: Adding query filter params (name=network) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:14.067019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f93ee-65c4-4112-97e8-b247c2730763 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:14.069448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f93ee-65c4-4112-97e8-b247c2730763 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:14.077579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 362/718] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:14.083305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cf55b-cd12-4ed2-8db0-715b82989ad7 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:14.194585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cf55b-cd12-4ed2-8db0-715b82989ad7 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:14.230875 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703da8b2-13a6-4452-9145-643516059828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:14.231973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703da8b2-13a6-4452-9145-643516059828 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:14.232513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703da8b2-13a6-4452-9145-643516059828 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:14.232997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703da8b2-13a6-4452-9145-643516059828 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:14.233985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703da8b2-13a6-4452-9145-643516059828 None admin] RBAC: Adding query filter params (type=network) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:14.234493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703da8b2-13a6-4452-9145-643516059828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:14.236137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703da8b2-13a6-4452-9145-643516059828 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:14.242264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 357/719] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:15.161385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34d17b-29cb-4c29-8ef7-49aa037436c6 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:15.162687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34d17b-29cb-4c29-8ef7-49aa037436c6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:15.163270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34d17b-29cb-4c29-8ef7-49aa037436c6 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:15.165924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 363/720] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:15.171402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dee29-41c8-411a-b752-4f5d66a09c25 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:15.172052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dee29-41c8-411a-b752-4f5d66a09c25 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:15.172272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dee29-41c8-411a-b752-4f5d66a09c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:15.192542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-a21dee29-41c8-411a-b752-4f5d66a09c25 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:15.193755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-a21dee29-41c8-411a-b752-4f5d66a09c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:15.206022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:15.282298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 358/721] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:01:15.317202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34d17b-29cb-4c29-8ef7-49aa037436c6 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:15.344437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:15.460298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34d17b-29cb-4c29-8ef7-49aa037436c6 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:15.517321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265da718-0cf5-4640-a7ac-8c2210970928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:15.518137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265da718-0cf5-4640-a7ac-8c2210970928 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:15.518425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265da718-0cf5-4640-a7ac-8c2210970928 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:15.518710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265da718-0cf5-4640-a7ac-8c2210970928 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:15.539282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265da718-0cf5-4640-a7ac-8c2210970928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-265da718-0cf5-4640-a7ac-8c2210970928 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:15.552194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:15.553127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:15.553972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 364/722] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:15.559261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dee29-41c8-411a-b752-4f5d66a09c25 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:15.616108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea943f-6c3a-45e0-93f9-7dba2b30614e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:15.616447 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea943f-6c3a-45e0-93f9-7dba2b30614e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:15.616672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea943f-6c3a-45e0-93f9-7dba2b30614e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:15.618378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 365/723] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:15.624222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c4da9-935b-40e4-a922-4e7fb6aacf3c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:15.624564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c4da9-935b-40e4-a922-4e7fb6aacf3c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:15.625016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c4da9-935b-40e4-a922-4e7fb6aacf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:15.643316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a21c4da9-935b-40e4-a922-4e7fb6aacf3c None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:15.644616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a21c4da9-935b-40e4-a922-4e7fb6aacf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:15.724747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dee29-41c8-411a-b752-4f5d66a09c25 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:15.741303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 366/724] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:01:15.765437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646c5bc-a990-426a-b263-7f5f752c0c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:15.766289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646c5bc-a990-426a-b263-7f5f752c0c5a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:15.766672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646c5bc-a990-426a-b263-7f5f752c0c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:15.767046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646c5bc-a990-426a-b263-7f5f752c0c5a None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:15.767939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646c5bc-a990-426a-b263-7f5f752c0c5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:15.768348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646c5bc-a990-426a-b263-7f5f752c0c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:15.769819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646c5bc-a990-426a-b263-7f5f752c0c5a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:15.775099 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c4da9-935b-40e4-a922-4e7fb6aacf3c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:15.787386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:15.790815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 359/725] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:01:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:15.797052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646c5bc-a990-426a-b263-7f5f752c0c5a None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:15.816079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:15.944522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c4da9-935b-40e4-a922-4e7fb6aacf3c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:15.962030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646c5bc-a990-426a-b263-7f5f752c0c5a None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.007123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80514368-ea68-4311-950f-9503b16b1a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.007881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80514368-ea68-4311-950f-9503b16b1a58 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.008166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80514368-ea68-4311-950f-9503b16b1a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.008441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80514368-ea68-4311-950f-9503b16b1a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.027998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b234d-18cb-456c-b9ac-a89686527548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.028817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b234d-18cb-456c-b9ac-a89686527548 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.029102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b234d-18cb-456c-b9ac-a89686527548 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.029380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b234d-18cb-456c-b9ac-a89686527548 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.030904 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80514368-ea68-4311-950f-9503b16b1a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.032714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80514368-ea68-4311-950f-9503b16b1a58 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.049366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b234d-18cb-456c-b9ac-a89686527548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-549b234d-18cb-456c-b9ac-a89686527548 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:16.058136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:16.059166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:16.060083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:16.060083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:16.060083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:16.060083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:16.060083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:16.060083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:16.060083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:16.060083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:16.060083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:16.060083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:16.060083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:16.060083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:16.061358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 367/726] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:01:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-80514368-ea68-4311-950f-9503b16b1a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:16.072370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:16.073309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:16.074206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:16.074206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:16.074206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:16.074206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:16.074206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 360/727] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:16.074931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b234d-18cb-456c-b9ac-a89686527548 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.079385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80514368-ea68-4311-950f-9503b16b1a58 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.195944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:16.205761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:16.239193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b234d-18cb-456c-b9ac-a89686527548 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.275261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a277ab0-bfed-480f-afba-5a085b824893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.276120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a277ab0-bfed-480f-afba-5a085b824893 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.276656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a277ab0-bfed-480f-afba-5a085b824893 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.277031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a277ab0-bfed-480f-afba-5a085b824893 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.277917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a277ab0-bfed-480f-afba-5a085b824893 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:16.278323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a277ab0-bfed-480f-afba-5a085b824893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.279857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a277ab0-bfed-480f-afba-5a085b824893 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.290158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 368/728] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:16.296152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a277ab0-bfed-480f-afba-5a085b824893 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.306394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80514368-ea68-4311-950f-9503b16b1a58 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.390434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557c5d1-5866-48fe-8818-d77f43551f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.391121 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557c5d1-5866-48fe-8818-d77f43551f59 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.391409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557c5d1-5866-48fe-8818-d77f43551f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.391719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557c5d1-5866-48fe-8818-d77f43551f59 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.392470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557c5d1-5866-48fe-8818-d77f43551f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:16.392784 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557c5d1-5866-48fe-8818-d77f43551f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.394172 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557c5d1-5866-48fe-8818-d77f43551f59 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.424742 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 361/729] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:16.428412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a277ab0-bfed-480f-afba-5a085b824893 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.429832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557c5d1-5866-48fe-8818-d77f43551f59 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.479444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddf3f9-eae0-44e9-988f-07f2f789ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.480385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddf3f9-eae0-44e9-988f-07f2f789ab62 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.480677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddf3f9-eae0-44e9-988f-07f2f789ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.481024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddf3f9-eae0-44e9-988f-07f2f789ab62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.489120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:16.496852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddf3f9-eae0-44e9-988f-07f2f789ab62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.498858 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddf3f9-eae0-44e9-988f-07f2f789ab62 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a4ddf3f9-eae0-44e9-988f-07f2f789ab62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:16.531166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:16.532464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:16.533373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:16.533373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:16.533373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:16.533373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:16.540367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 369/730] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:16.543593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddf3f9-eae0-44e9-988f-07f2f789ab62 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.653457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557c5d1-5866-48fe-8818-d77f43551f59 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.696139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:16.721305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81830dc0-d56b-45fd-8153-924c66209d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.722411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81830dc0-d56b-45fd-8153-924c66209d96 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.722697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81830dc0-d56b-45fd-8153-924c66209d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.722977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81830dc0-d56b-45fd-8153-924c66209d96 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.724513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddf3f9-eae0-44e9-988f-07f2f789ab62 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.732467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81830dc0-d56b-45fd-8153-924c66209d96 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.733940 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81830dc0-d56b-45fd-8153-924c66209d96 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-81830dc0-d56b-45fd-8153-924c66209d96 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:16.754618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:16.755915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:16.756876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:16.756876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:16.756876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:16.756876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:16.756876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:16.756876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:16.756876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:16.756876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:16.756876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 15:01:16.756876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:16.756876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 362/731] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:16.757815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d2403-afae-4318-8a41-006fb6b5712d None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.757909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d2403-afae-4318-8a41-006fb6b5712d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.758184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d2403-afae-4318-8a41-006fb6b5712d None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.764772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 363/732] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:16.764772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d2403-afae-4318-8a41-006fb6b5712d None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.768817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b43e9-57d8-4b3f-9cba-40e92f312d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.769753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b43e9-57d8-4b3f-9cba-40e92f312d0f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.770241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b43e9-57d8-4b3f-9cba-40e92f312d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.770752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b43e9-57d8-4b3f-9cba-40e92f312d0f None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.771730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b43e9-57d8-4b3f-9cba-40e92f312d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:16.772262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b43e9-57d8-4b3f-9cba-40e92f312d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.774004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b43e9-57d8-4b3f-9cba-40e92f312d0f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.787473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 370/733] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:16.789289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2733384-cb79-431d-9b37-50d07034912b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.789781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2733384-cb79-431d-9b37-50d07034912b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.790278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2733384-cb79-431d-9b37-50d07034912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.809157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c2733384-cb79-431d-9b37-50d07034912b None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:16.810363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c2733384-cb79-431d-9b37-50d07034912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:16.859233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:16.874856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d2403-afae-4318-8a41-006fb6b5712d None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:16.888433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 371/734] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:01:16.889537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2733384-cb79-431d-9b37-50d07034912b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.922576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142913e-4f73-49bd-9948-9e547462911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:16.923272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142913e-4f73-49bd-9948-9e547462911e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.923632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142913e-4f73-49bd-9948-9e547462911e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.923996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142913e-4f73-49bd-9948-9e547462911e None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.924857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142913e-4f73-49bd-9948-9e547462911e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:16.925190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142913e-4f73-49bd-9948-9e547462911e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:16.926616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142913e-4f73-49bd-9948-9e547462911e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:16.945690 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 364/735] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:16.947228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7aaff-0427-4794-a11f-684a3eef048e None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:16.947731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7aaff-0427-4794-a11f-684a3eef048e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:16.948094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7aaff-0427-4794-a11f-684a3eef048e None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:16.949594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 365/736] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:16.950161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7aaff-0427-4794-a11f-684a3eef048e None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:16.994123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.012021 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2733384-cb79-431d-9b37-50d07034912b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.045972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d1829-fdd1-4da2-98ac-40ccee2c62a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:17.046715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d1829-fdd1-4da2-98ac-40ccee2c62a4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.046993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d1829-fdd1-4da2-98ac-40ccee2c62a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.047294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d1829-fdd1-4da2-98ac-40ccee2c62a4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.054073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7aaff-0427-4794-a11f-684a3eef048e None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.054483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d1829-fdd1-4da2-98ac-40ccee2c62a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:17.055965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d1829-fdd1-4da2-98ac-40ccee2c62a4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4c1d1829-fdd1-4da2-98ac-40ccee2c62a4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:17.070727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:17.071721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:17.072709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:17.072709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:17.072709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:17.072709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:17.072709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:17.072709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:17.072709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:17.072709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:17.072709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 15:01:17.072709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:17.072709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 372/737] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 15:01:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:17.073998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451bc0d-0e4e-4a50-9b7c-5dd2b353fd14 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.073998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451bc0d-0e4e-4a50-9b7c-5dd2b353fd14 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.074250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451bc0d-0e4e-4a50-9b7c-5dd2b353fd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.090660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6451bc0d-0e4e-4a50-9b7c-5dd2b353fd14 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:17.091413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ff330-869f-44b4-a492-40e3d32d4deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:17.091866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6451bc0d-0e4e-4a50-9b7c-5dd2b353fd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:17.092118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ff330-869f-44b4-a492-40e3d32d4deb None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.092405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ff330-869f-44b4-a492-40e3d32d4deb None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.092686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ff330-869f-44b4-a492-40e3d32d4deb None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.093419 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ff330-869f-44b4-a492-40e3d32d4deb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:17.094797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ff330-869f-44b4-a492-40e3d32d4deb None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:17.109844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 366/738] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 15:01:16 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:17.110705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ff330-869f-44b4-a492-40e3d32d4deb None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:17.120736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.182818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 373/739] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:01:17.184643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dbca-afb4-487e-ab4c-fbf69004f1fa None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.184939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dbca-afb4-487e-ab4c-fbf69004f1fa None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.185220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dbca-afb4-487e-ab4c-fbf69004f1fa None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.186700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 374/740] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:17.187231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9dbca-afb4-487e-ab4c-fbf69004f1fa None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:17.241722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.248696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ff330-869f-44b4-a492-40e3d32d4deb None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.287069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113b0fe-e5d5-488e-8e8c-1d7fe6131e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:17.287772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113b0fe-e5d5-488e-8e8c-1d7fe6131e4e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.288047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113b0fe-e5d5-488e-8e8c-1d7fe6131e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.288320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113b0fe-e5d5-488e-8e8c-1d7fe6131e4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.312782 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9dbca-afb4-487e-ab4c-fbf69004f1fa None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.349228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102d308-7621-4f7c-877b-583af6ebc5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:17.349903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102d308-7621-4f7c-877b-583af6ebc5bc None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.350187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102d308-7621-4f7c-877b-583af6ebc5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.350463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102d308-7621-4f7c-877b-583af6ebc5bc None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.351308 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102d308-7621-4f7c-877b-583af6ebc5bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:17.351642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102d308-7621-4f7c-877b-583af6ebc5bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:17.353074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102d308-7621-4f7c-877b-583af6ebc5bc None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:17.363803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113b0fe-e5d5-488e-8e8c-1d7fe6131e4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:17.365548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113b0fe-e5d5-488e-8e8c-1d7fe6131e4e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:17.370356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 375/741] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 15:01:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:17.371634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74cccf-34b2-40cc-acb2-ef11b8b801b0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.371925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74cccf-34b2-40cc-acb2-ef11b8b801b0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.372201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74cccf-34b2-40cc-acb2-ef11b8b801b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.390314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0f74cccf-34b2-40cc-acb2-ef11b8b801b0 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:17.391617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0f74cccf-34b2-40cc-acb2-ef11b8b801b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:17.405304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.468467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.468720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 376/742] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:01:17.469721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74cccf-34b2-40cc-acb2-ef11b8b801b0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:17.489029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 367/743] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:01:17.490737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113b0fe-e5d5-488e-8e8c-1d7fe6131e4e None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:17.580294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74cccf-34b2-40cc-acb2-ef11b8b801b0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.588844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113b0fe-e5d5-488e-8e8c-1d7fe6131e4e None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.616395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6d41e-8125-47ca-9f14-92f5953b5dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:17.617211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6d41e-8125-47ca-9f14-92f5953b5dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.617497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6d41e-8125-47ca-9f14-92f5953b5dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.617890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6d41e-8125-47ca-9f14-92f5953b5dc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.626474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69377e7-5ed8-440a-9b01-2f8e419618c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:17.627133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69377e7-5ed8-440a-9b01-2f8e419618c3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.627416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69377e7-5ed8-440a-9b01-2f8e419618c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.627736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69377e7-5ed8-440a-9b01-2f8e419618c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.628840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6d41e-8125-47ca-9f14-92f5953b5dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-1cb6d41e-8125-47ca-9f14-92f5953b5dc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:17.637048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:17.638004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:17.638840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 377/744] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:01:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:17.639579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6d41e-8125-47ca-9f14-92f5953b5dc0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:17.652544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.703570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.707095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69377e7-5ed8-440a-9b01-2f8e419618c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:17.708889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69377e7-5ed8-440a-9b01-2f8e419618c3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:17.752062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6d41e-8125-47ca-9f14-92f5953b5dc0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.791250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a115a4d-a44f-40d8-9c90-aa5c799fa98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:17.792258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a115a4d-a44f-40d8-9c90-aa5c799fa98e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.792660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a115a4d-a44f-40d8-9c90-aa5c799fa98e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.792946 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a115a4d-a44f-40d8-9c90-aa5c799fa98e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.807957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a115a4d-a44f-40d8-9c90-aa5c799fa98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:17.809430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a115a4d-a44f-40d8-9c90-aa5c799fa98e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:17.814908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 368/745] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:01:17.814908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69377e7-5ed8-440a-9b01-2f8e419618c3 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9a115a4d-a44f-40d8-9c90-aa5c799fa98e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:17.831818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:17.832841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:17.833897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:17.833897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:17.833897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:17.833897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:17.834368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 378/746] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:17.834368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a115a4d-a44f-40d8-9c90-aa5c799fa98e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:17.910766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.929208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:17.933659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69377e7-5ed8-440a-9b01-2f8e419618c3 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.960629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a115a4d-a44f-40d8-9c90-aa5c799fa98e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:17.973784 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad445c9-9f66-4b06-96b5-19146359e5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:17.974467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad445c9-9f66-4b06-96b5-19146359e5a2 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:17.974765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad445c9-9f66-4b06-96b5-19146359e5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:17.975319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad445c9-9f66-4b06-96b5-19146359e5a2 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:17.975780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad445c9-9f66-4b06-96b5-19146359e5a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:17.977166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad445c9-9f66-4b06-96b5-19146359e5a2 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:17.992714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 369/747] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 15:01:17 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:18.001065 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad445c9-9f66-4b06-96b5-19146359e5a2 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.003081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2586d6-1409-4298-96a8-a5a08df9546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:18.003924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2586d6-1409-4298-96a8-a5a08df9546e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.004313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2586d6-1409-4298-96a8-a5a08df9546e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.004684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2586d6-1409-4298-96a8-a5a08df9546e None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.005897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2586d6-1409-4298-96a8-a5a08df9546e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:18.007248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2586d6-1409-4298-96a8-a5a08df9546e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:18.008850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2586d6-1409-4298-96a8-a5a08df9546e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:18.027835 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 379/748] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:01:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:18.030287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2586d6-1409-4298-96a8-a5a08df9546e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.161087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad445c9-9f66-4b06-96b5-19146359e5a2 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:18.171482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2586d6-1409-4298-96a8-a5a08df9546e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:18.194494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:18.210073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f59b1c-213f-4d03-8f98-25c0f5603b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:18.211476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f59b1c-213f-4d03-8f98-25c0f5603b15 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.211797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f59b1c-213f-4d03-8f98-25c0f5603b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.212080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f59b1c-213f-4d03-8f98-25c0f5603b15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.216911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9946f-fad3-4df8-9b3e-5ded0c26bbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:18.216911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9946f-fad3-4df8-9b3e-5ded0c26bbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.216911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9946f-fad3-4df8-9b3e-5ded0c26bbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.218124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9946f-fad3-4df8-9b3e-5ded0c26bbe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.218624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9946f-fad3-4df8-9b3e-5ded0c26bbe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:18.219055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9946f-fad3-4df8-9b3e-5ded0c26bbe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:18.223873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9946f-fad3-4df8-9b3e-5ded0c26bbe6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:18.225764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f59b1c-213f-4d03-8f98-25c0f5603b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:18.227609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f59b1c-213f-4d03-8f98-25c0f5603b15 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:18.237303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 380/749] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:18.238613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9946f-fad3-4df8-9b3e-5ded0c26bbe6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-83f59b1c-213f-4d03-8f98-25c0f5603b15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:18.255768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:18.257275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:18.258390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:18.258390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:18.258390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:18.258390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:18.263695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 370/750] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:18.263695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f59b1c-213f-4d03-8f98-25c0f5603b15 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.278313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:18.377859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9946f-fad3-4df8-9b3e-5ded0c26bbe6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:18.389820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f59b1c-213f-4d03-8f98-25c0f5603b15 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:18.425293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c56b9e-0818-4402-b914-951614b1b911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:18.426469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c56b9e-0818-4402-b914-951614b1b911 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.426873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c56b9e-0818-4402-b914-951614b1b911 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.427157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c56b9e-0818-4402-b914-951614b1b911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.439035 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3277-e171-41ef-aa6b-371662c7b2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:18.440523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3277-e171-41ef-aa6b-371662c7b2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.440989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3277-e171-41ef-aa6b-371662c7b2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.441341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3277-e171-41ef-aa6b-371662c7b2f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.441618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c56b9e-0818-4402-b914-951614b1b911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:18.443155 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c56b9e-0818-4402-b914-951614b1b911 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:18.449294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3277-e171-41ef-aa6b-371662c7b2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:18.450816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3277-e171-41ef-aa6b-371662c7b2f6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-03c56b9e-0818-4402-b914-951614b1b911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:18.466541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:18.467483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:18.468427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:18.468427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:18.468427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:18.468427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:18.468427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 381/751] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:18.469151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c56b9e-0818-4402-b914-951614b1b911 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-35bc3277-e171-41ef-aa6b-371662c7b2f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:18.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:18.476013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:18.476898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:18.476898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:18.476898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:18.476898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:18.476898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:18.476898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:18.476898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:18.476898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:18.479786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 371/752] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:18.480785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3277-e171-41ef-aa6b-371662c7b2f6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.505892 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:18.567190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:18.590311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c56b9e-0818-4402-b914-951614b1b911 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:18.603674 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3277-e171-41ef-aa6b-371662c7b2f6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:18.627414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1081da-5bee-4bf8-826f-e455f56d75cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:18.628553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1081da-5bee-4bf8-826f-e455f56d75cb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.628901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1081da-5bee-4bf8-826f-e455f56d75cb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.629249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1081da-5bee-4bf8-826f-e455f56d75cb None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.630054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1081da-5bee-4bf8-826f-e455f56d75cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:18.630428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1081da-5bee-4bf8-826f-e455f56d75cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:18.632018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1081da-5bee-4bf8-826f-e455f56d75cb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:18.645076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 382/753] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:18.645545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad267815-287e-4e71-823f-5bd722a22062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:18.646073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1081da-5bee-4bf8-826f-e455f56d75cb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.646657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad267815-287e-4e71-823f-5bd722a22062 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.647196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad267815-287e-4e71-823f-5bd722a22062 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.647721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad267815-287e-4e71-823f-5bd722a22062 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.648890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad267815-287e-4e71-823f-5bd722a22062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:18.650544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad267815-287e-4e71-823f-5bd722a22062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:18.652212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad267815-287e-4e71-823f-5bd722a22062 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:18.666744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 372/754] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:18.668186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad267815-287e-4e71-823f-5bd722a22062 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.757554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:18.768835 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1081da-5bee-4bf8-826f-e455f56d75cb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:18.782300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad267815-287e-4e71-823f-5bd722a22062 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:18.812068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe74c6-a12f-403e-b63e-7c426d2e9f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:18.812759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe74c6-a12f-403e-b63e-7c426d2e9f4d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.813050 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe74c6-a12f-403e-b63e-7c426d2e9f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.813335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe74c6-a12f-403e-b63e-7c426d2e9f4d None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.814196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe74c6-a12f-403e-b63e-7c426d2e9f4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:18.814515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe74c6-a12f-403e-b63e-7c426d2e9f4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:18.814743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:18.816183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe74c6-a12f-403e-b63e-7c426d2e9f4d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:18.822340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14e0e3-b17c-45a8-b8e9-b8c9e1441faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:18.823470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14e0e3-b17c-45a8-b8e9-b8c9e1441faf None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:18.823979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14e0e3-b17c-45a8-b8e9-b8c9e1441faf None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:18.824525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14e0e3-b17c-45a8-b8e9-b8c9e1441faf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:18.832629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14e0e3-b17c-45a8-b8e9-b8c9e1441faf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:18.833450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 383/755] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:18.834173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14e0e3-b17c-45a8-b8e9-b8c9e1441faf None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:18.834698 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe74c6-a12f-403e-b63e-7c426d2e9f4d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-2e14e0e3-b17c-45a8-b8e9-b8c9e1441faf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:18.858088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:18.859074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:18.860108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:18.860108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:18.860108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:18.860108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:18.860108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:18.860108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:18.860108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:18.860108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:18.860108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 373/756] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:18.860599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14e0e3-b17c-45a8-b8e9-b8c9e1441faf None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:18.959250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe74c6-a12f-403e-b63e-7c426d2e9f4d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:18.981144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14e0e3-b17c-45a8-b8e9-b8c9e1441faf None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:19.004891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115e5e2-bf69-47ed-acde-a7c39b3f92be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.006619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115e5e2-bf69-47ed-acde-a7c39b3f92be None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.007051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115e5e2-bf69-47ed-acde-a7c39b3f92be None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.007702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115e5e2-bf69-47ed-acde-a7c39b3f92be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.016812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a35b15-67f4-4176-a786-9ebf3d765f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.017339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115e5e2-bf69-47ed-acde-a7c39b3f92be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.017469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a35b15-67f4-4176-a786-9ebf3d765f90 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.017740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a35b15-67f4-4176-a786-9ebf3d765f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.018012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a35b15-67f4-4176-a786-9ebf3d765f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.018856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a35b15-67f4-4176-a786-9ebf3d765f90 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=1643cf33cd3b417bb2cd15b5503f7ffd) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:19.019166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a35b15-67f4-4176-a786-9ebf3d765f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.020012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115e5e2-bf69-47ed-acde-a7c39b3f92be None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.020632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a35b15-67f4-4176-a786-9ebf3d765f90 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.026593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 374/757] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:18 2022] GET /identity/v3/role_assignments?user.id=1643cf33cd3b417bb2cd15b5503f7ffd&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:19.027377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a35b15-67f4-4176-a786-9ebf3d765f90 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9115e5e2-bf69-47ed-acde-a7c39b3f92be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:19.036564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:19.037564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:19.038529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:19.038529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:19.038529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:19.038529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:19.038529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:19.038529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:19.038529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:19.038529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:19.038529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:01:19.038529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:19.041249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 384/758] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 15:01:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:19.052655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115e5e2-bf69-47ed-acde-a7c39b3f92be None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:19.074659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:19.095586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:19.145894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a35b15-67f4-4176-a786-9ebf3d765f90 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:19.196432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d491b0b-d595-4e3a-8b72-36af173099d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.197651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d491b0b-d595-4e3a-8b72-36af173099d9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.197651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d491b0b-d595-4e3a-8b72-36af173099d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.197840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d491b0b-d595-4e3a-8b72-36af173099d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.198643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d491b0b-d595-4e3a-8b72-36af173099d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:19.198957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d491b0b-d595-4e3a-8b72-36af173099d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.200540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d491b0b-d595-4e3a-8b72-36af173099d9 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.214009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115e5e2-bf69-47ed-acde-a7c39b3f92be None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:19.218067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 375/759] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:19.225926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d491b0b-d595-4e3a-8b72-36af173099d9 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:19.261463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d689b-24a3-432f-9116-78a1b0d070c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.263251 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d689b-24a3-432f-9116-78a1b0d070c7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.263795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d689b-24a3-432f-9116-78a1b0d070c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.264420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d689b-24a3-432f-9116-78a1b0d070c7 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.265508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d689b-24a3-432f-9116-78a1b0d070c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:19.266049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d689b-24a3-432f-9116-78a1b0d070c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.273529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d689b-24a3-432f-9116-78a1b0d070c7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.306486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 385/760] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 15:01:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:19.312579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d689b-24a3-432f-9116-78a1b0d070c7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:19.362370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d491b0b-d595-4e3a-8b72-36af173099d9 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:19.381556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:19.405687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663c83a-66fd-493d-bc61-4b4184d68530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.406356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663c83a-66fd-493d-bc61-4b4184d68530 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.406641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663c83a-66fd-493d-bc61-4b4184d68530 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.406920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663c83a-66fd-493d-bc61-4b4184d68530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.408260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663c83a-66fd-493d-bc61-4b4184d68530 None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=042393fa408b45208021befccd6bd800) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:19.408585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663c83a-66fd-493d-bc61-4b4184d68530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.410308 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663c83a-66fd-493d-bc61-4b4184d68530 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.417154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 376/761] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:19 2022] GET /identity/v3/role_assignments?user.id=042393fa408b45208021befccd6bd800&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:19.418609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96f54d-fbd6-4522-8ed9-928d0a4c7186 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.418905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96f54d-fbd6-4522-8ed9-928d0a4c7186 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.419185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96f54d-fbd6-4522-8ed9-928d0a4c7186 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.420762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 377/762] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:19.440854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a2fd9-2a59-409b-b44e-40347be70eb4 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.441161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a2fd9-2a59-409b-b44e-40347be70eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.441424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a2fd9-2a59-409b-b44e-40347be70eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.454589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:19.472852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-629a2fd9-2a59-409b-b44e-40347be70eb4 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:19.476470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-629a2fd9-2a59-409b-b44e-40347be70eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:19.533075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d689b-24a3-432f-9116-78a1b0d070c7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:19.615085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aec2e-dfbf-49ff-8fca-e0b14e44f897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.616858 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aec2e-dfbf-49ff-8fca-e0b14e44f897 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.618169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aec2e-dfbf-49ff-8fca-e0b14e44f897 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.619225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aec2e-dfbf-49ff-8fca-e0b14e44f897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.631260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 378/763] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:19.637354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617aec2e-dfbf-49ff-8fca-e0b14e44f897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.638815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617aec2e-dfbf-49ff-8fca-e0b14e44f897 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.655883 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a2fd9-2a59-409b-b44e-40347be70eb4 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-617aec2e-dfbf-49ff-8fca-e0b14e44f897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:19.666659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:19.668707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:19.669767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:19.669767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:19.669767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:19.669767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:19.669767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 386/764] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:19.676054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aec2e-dfbf-49ff-8fca-e0b14e44f897 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:19.814183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aec2e-dfbf-49ff-8fca-e0b14e44f897 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:19.843952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:19.849673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a2fd9-2a59-409b-b44e-40347be70eb4 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:19.853066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a19b3-733a-4e65-90a5-2b71e982ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.853966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a19b3-733a-4e65-90a5-2b71e982ef25 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.855317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a19b3-733a-4e65-90a5-2b71e982ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.855817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a19b3-733a-4e65-90a5-2b71e982ef25 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.856781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a19b3-733a-4e65-90a5-2b71e982ef25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:19.857293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a19b3-733a-4e65-90a5-2b71e982ef25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.858837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a19b3-733a-4e65-90a5-2b71e982ef25 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.870122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:19.872863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 387/765] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:19.879103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a19b3-733a-4e65-90a5-2b71e982ef25 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:19.942064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205233f2-7539-482e-aea8-c58f3942a3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:19.942904 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205233f2-7539-482e-aea8-c58f3942a3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:19.943191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205233f2-7539-482e-aea8-c58f3942a3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:19.943471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205233f2-7539-482e-aea8-c58f3942a3d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:19.944182 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205233f2-7539-482e-aea8-c58f3942a3d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:19.945615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205233f2-7539-482e-aea8-c58f3942a3d6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-205233f2-7539-482e-aea8-c58f3942a3d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:19.972679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:19.973694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:01:19.974554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:19.979271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 379/766] 10.222.0.24 () {56 vars in 1129 bytes} [Wed May 25 15:01:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:19.984412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205233f2-7539-482e-aea8-c58f3942a3d6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:20.040978 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a19b3-733a-4e65-90a5-2b71e982ef25 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:20.104836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b826e-c08c-4fe9-8e81-54e54ac054f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:20.106505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b826e-c08c-4fe9-8e81-54e54ac054f5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.107810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b826e-c08c-4fe9-8e81-54e54ac054f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.108873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b826e-c08c-4fe9-8e81-54e54ac054f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.125075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b826e-c08c-4fe9-8e81-54e54ac054f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:20.127681 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b826e-c08c-4fe9-8e81-54e54ac054f5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-533b826e-c08c-4fe9-8e81-54e54ac054f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:20.159944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:20.160913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:20.161826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:20.161826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:20.161826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:20.161826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:20.161826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:20.161826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:20.161826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:20.161826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:20.166548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 388/767] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:20.175589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b826e-c08c-4fe9-8e81-54e54ac054f5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:20.187914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205233f2-7539-482e-aea8-c58f3942a3d6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:20.225413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41b37b-febf-4024-b3c9-265b78b3e4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:20.226094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41b37b-febf-4024-b3c9-265b78b3e4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.226422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41b37b-febf-4024-b3c9-265b78b3e4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.226705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41b37b-febf-4024-b3c9-265b78b3e4d7 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.227432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41b37b-febf-4024-b3c9-265b78b3e4d7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:20.227773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41b37b-febf-4024-b3c9-265b78b3e4d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:20.229166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41b37b-febf-4024-b3c9-265b78b3e4d7 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:20.234547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 380/768] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 15:01:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:20.240800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41b37b-febf-4024-b3c9-265b78b3e4d7 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:20.253951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:20.303980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:20.363536 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41b37b-febf-4024-b3c9-265b78b3e4d7 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:20.408611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81a8ee-bea2-4e88-b70c-c7a5f3321c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:20.409299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81a8ee-bea2-4e88-b70c-c7a5f3321c57 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.409583 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81a8ee-bea2-4e88-b70c-c7a5f3321c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.409864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81a8ee-bea2-4e88-b70c-c7a5f3321c57 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.410597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81a8ee-bea2-4e88-b70c-c7a5f3321c57 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:20.410909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81a8ee-bea2-4e88-b70c-c7a5f3321c57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:20.415457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81a8ee-bea2-4e88-b70c-c7a5f3321c57 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:20.428542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 381/769] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 15:01:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:20.433042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81a8ee-bea2-4e88-b70c-c7a5f3321c57 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:20.439094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b826e-c08c-4fe9-8e81-54e54ac054f5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:20.516322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce6b32-43f9-43a0-a4fb-c6f02f884256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:20.516985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6b32-43f9-43a0-a4fb-c6f02f884256 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.517270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6b32-43f9-43a0-a4fb-c6f02f884256 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.517546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6b32-43f9-43a0-a4fb-c6f02f884256 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.518352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce6b32-43f9-43a0-a4fb-c6f02f884256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:20.518663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce6b32-43f9-43a0-a4fb-c6f02f884256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:20.523698 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce6b32-43f9-43a0-a4fb-c6f02f884256 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:20.550534 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 389/770] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:20.557960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26a50-b2af-4c24-81df-2732a28adcf5 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.558259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26a50-b2af-4c24-81df-2732a28adcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.558578 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26a50-b2af-4c24-81df-2732a28adcf5 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.560249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 390/771] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:20.560944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f26a50-b2af-4c24-81df-2732a28adcf5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:20.601514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:20.604554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81a8ee-bea2-4e88-b70c-c7a5f3321c57 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:20.640200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720fd3e-31c1-4027-a0b3-98d768a0da86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:20.640934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720fd3e-31c1-4027-a0b3-98d768a0da86 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.641320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720fd3e-31c1-4027-a0b3-98d768a0da86 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.641719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720fd3e-31c1-4027-a0b3-98d768a0da86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.642676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720fd3e-31c1-4027-a0b3-98d768a0da86 None admin] RBAC: Adding query filter params (interface=public, service_id=da9f68ef12464cc3a7efca3221e401bf, region_id=RegionOne) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:20.643088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720fd3e-31c1-4027-a0b3-98d768a0da86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:20.644651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720fd3e-31c1-4027-a0b3-98d768a0da86 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:20.652963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 382/772] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 15:01:20 2022] GET /identity/v3/endpoints?service_id=da9f68ef12464cc3a7efca3221e401bf&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:20.654379 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f11812-16cf-463b-bacb-1768a0c732e9 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.654780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f11812-16cf-463b-bacb-1768a0c732e9 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.655125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f11812-16cf-463b-bacb-1768a0c732e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.667416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:20.672780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f26a50-b2af-4c24-81df-2732a28adcf5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:20.673034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-95f11812-16cf-463b-bacb-1768a0c732e9 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:20.674371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-95f11812-16cf-463b-bacb-1768a0c732e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:20.710835 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8cfdd-511f-49cc-9c13-a2b0176a659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:20.711853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8cfdd-511f-49cc-9c13-a2b0176a659b None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.712141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8cfdd-511f-49cc-9c13-a2b0176a659b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.712421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8cfdd-511f-49cc-9c13-a2b0176a659b None admin] PATH_INFO: `/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/f553cee02ab345dabbef807bfe85544a/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.714560 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8cfdd-511f-49cc-9c13-a2b0176a659b None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ad2e4552f43f09ebf85b6c82a5481, user_id=f553cee02ab345dabbef807bfe85544a, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:20.716132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8cfdd-511f-49cc-9c13-a2b0176a659b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:20.731882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 391/773] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:01:20 2022] PUT /identity/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/f553cee02ab345dabbef807bfe85544a/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:20.740529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8cfdd-511f-49cc-9c13-a2b0176a659b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:20.762937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 383/774] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:20.786179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f11812-16cf-463b-bacb-1768a0c732e9 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:20.896002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f11812-16cf-463b-bacb-1768a0c732e9 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:20.899505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:20.936217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93720eae-fb5e-4b8d-943a-c4ef405c0b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:20.937051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720eae-fb5e-4b8d-943a-c4ef405c0b09 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:20.937339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720eae-fb5e-4b8d-943a-c4ef405c0b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:20.937618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720eae-fb5e-4b8d-943a-c4ef405c0b09 None admin] PATH_INFO: `/v3/services/network` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:20.938301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93720eae-fb5e-4b8d-943a-c4ef405c0b09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:20.939864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93720eae-fb5e-4b8d-943a-c4ef405c0b09 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-93720eae-fb5e-4b8d-943a-c4ef405c0b09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:20.952816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:20.953990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:01:20.954857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:20.959202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 384/775] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:20 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:20.960535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93720eae-fb5e-4b8d-943a-c4ef405c0b09 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:20.985715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8cfdd-511f-49cc-9c13-a2b0176a659b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:21.030410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f97fb-9b67-43c0-aa80-f0bb1b22b1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:21.031472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f97fb-9b67-43c0-aa80-f0bb1b22b1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.032001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f97fb-9b67-43c0-aa80-f0bb1b22b1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.032505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f97fb-9b67-43c0-aa80-f0bb1b22b1e5 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.033720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f97fb-9b67-43c0-aa80-f0bb1b22b1e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:21.035295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f97fb-9b67-43c0-aa80-f0bb1b22b1e5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:21.042936 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 392/776] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 15:01:20 2022] GET /identity/v3/services => generated 772 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:21.065452 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93720eae-fb5e-4b8d-943a-c4ef405c0b09 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:21.101696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f87774-72ca-4ef4-b8c1-b04648d4a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:21.102450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f87774-72ca-4ef4-b8c1-b04648d4a235 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.102739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f87774-72ca-4ef4-b8c1-b04648d4a235 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.103070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f87774-72ca-4ef4-b8c1-b04648d4a235 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.104130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f87774-72ca-4ef4-b8c1-b04648d4a235 None admin] RBAC: Adding query filter params (name=network) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:21.104449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f87774-72ca-4ef4-b8c1-b04648d4a235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:21.105967 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f87774-72ca-4ef4-b8c1-b04648d4a235 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:21.111781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 385/777] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:21.125256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f97fb-9b67-43c0-aa80-f0bb1b22b1e5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:21.175900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:21.270751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f97fb-9b67-43c0-aa80-f0bb1b22b1e5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:21.306412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8af2bc-4718-4b95-b988-05cfc02b7dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:21.307093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8af2bc-4718-4b95-b988-05cfc02b7dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.307382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8af2bc-4718-4b95-b988-05cfc02b7dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.307840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8af2bc-4718-4b95-b988-05cfc02b7dc5 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.308569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8af2bc-4718-4b95-b988-05cfc02b7dc5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:21.308990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8af2bc-4718-4b95-b988-05cfc02b7dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:21.310371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8af2bc-4718-4b95-b988-05cfc02b7dc5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:21.319675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 393/778] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:21.323440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f87774-72ca-4ef4-b8c1-b04648d4a235 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:21.351969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:21.433512 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f87774-72ca-4ef4-b8c1-b04648d4a235 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:21.468115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b18d8b-3798-4353-ba44-d1ab59e2bd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:21.468790 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b18d8b-3798-4353-ba44-d1ab59e2bd4c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.469078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b18d8b-3798-4353-ba44-d1ab59e2bd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.469358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b18d8b-3798-4353-ba44-d1ab59e2bd4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.470172 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b18d8b-3798-4353-ba44-d1ab59e2bd4c None admin] RBAC: Adding query filter params (interface=public, service_id=6f28a9dbfe244645bb61f79b63a515c2, region_id=RegionOne) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:21.470492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b18d8b-3798-4353-ba44-d1ab59e2bd4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:21.471916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b18d8b-3798-4353-ba44-d1ab59e2bd4c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:21.481896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 386/779] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 15:01:21 2022] GET /identity/v3/endpoints?service_id=6f28a9dbfe244645bb61f79b63a515c2&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:21.483265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8af2bc-4718-4b95-b988-05cfc02b7dc5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:21.570598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb2a1c-cf33-4885-bd9c-3c0d539bbcdf None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.571243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb2a1c-cf33-4885-bd9c-3c0d539bbcdf None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.571764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb2a1c-cf33-4885-bd9c-3c0d539bbcdf None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.573647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 387/780] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:21.578019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:21.579983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5161a0-d5e6-449c-b868-88329ab3fe52 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.580513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5161a0-d5e6-449c-b868-88329ab3fe52 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.581001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5161a0-d5e6-449c-b868-88329ab3fe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.599601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8af2bc-4718-4b95-b988-05cfc02b7dc5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:21.615257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-bc5161a0-d5e6-449c-b868-88329ab3fe52 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:21.616827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-bc5161a0-d5e6-449c-b868-88329ab3fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:21.654454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf14b4-946e-41d7-93a0-5d9f018b051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:21.655133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf14b4-946e-41d7-93a0-5d9f018b051d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.655414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf14b4-946e-41d7-93a0-5d9f018b051d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.656969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf14b4-946e-41d7-93a0-5d9f018b051d None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.657673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf14b4-946e-41d7-93a0-5d9f018b051d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:21.659477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf14b4-946e-41d7-93a0-5d9f018b051d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:21.673337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 394/781] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 15:01:21 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:21.736644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 388/782] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:21.771993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf14b4-946e-41d7-93a0-5d9f018b051d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:21.912735 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf14b4-946e-41d7-93a0-5d9f018b051d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:21.946852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaec2a3-970b-4fb3-9032-ce3676a0f7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:21.947683 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec2a3-970b-4fb3-9032-ce3676a0f7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:21.947968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec2a3-970b-4fb3-9032-ce3676a0f7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:21.948245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec2a3-970b-4fb3-9032-ce3676a0f7f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:21.959290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaec2a3-970b-4fb3-9032-ce3676a0f7f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3aaec2a3-970b-4fb3-9032-ce3676a0f7f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:21.967004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:21.968028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:21.968879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 395/783] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:01:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:21.975933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5161a0-d5e6-449c-b868-88329ab3fe52 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:21.996559 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:22.073908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33131-3705-4e5e-83cc-3b170bdc0834 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.074240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33131-3705-4e5e-83cc-3b170bdc0834 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.074484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33131-3705-4e5e-83cc-3b170bdc0834 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.076188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 396/784] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:22.083245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff2158-3b7a-4fc9-a910-83fe653b359c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.083540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff2158-3b7a-4fc9-a910-83fe653b359c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.083854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff2158-3b7a-4fc9-a910-83fe653b359c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.088641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5161a0-d5e6-449c-b868-88329ab3fe52 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:22.124657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c4ff2158-3b7a-4fc9-a910-83fe653b359c None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:22.125844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c4ff2158-3b7a-4fc9-a910-83fe653b359c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:22.128914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e930a6a-a523-4014-9b7f-6c7bae651568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:22.129611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e930a6a-a523-4014-9b7f-6c7bae651568 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.129892 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e930a6a-a523-4014-9b7f-6c7bae651568 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.130163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e930a6a-a523-4014-9b7f-6c7bae651568 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.130924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e930a6a-a523-4014-9b7f-6c7bae651568 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:22.131228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e930a6a-a523-4014-9b7f-6c7bae651568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:22.133981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e930a6a-a523-4014-9b7f-6c7bae651568 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:22.143141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 389/785] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:01:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:22.148091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:22.149241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e930a6a-a523-4014-9b7f-6c7bae651568 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:22.239197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:22.288742 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e930a6a-a523-4014-9b7f-6c7bae651568 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:22.304827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 397/786] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:22.327231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff2158-3b7a-4fc9-a910-83fe653b359c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:22.355748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbe80f-f8ca-42db-8ffd-3e7e56325856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:22.356607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbe80f-f8ca-42db-8ffd-3e7e56325856 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.356894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbe80f-f8ca-42db-8ffd-3e7e56325856 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.357173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbe80f-f8ca-42db-8ffd-3e7e56325856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.369279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbe80f-f8ca-42db-8ffd-3e7e56325856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:22.370760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbe80f-f8ca-42db-8ffd-3e7e56325856 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-34dbe80f-f8ca-42db-8ffd-3e7e56325856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:22.389062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:22.390005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:22.390906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:22.390906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:22.390906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:22.390906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:22.390906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 390/787] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:22.397267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbe80f-f8ca-42db-8ffd-3e7e56325856 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:22.521266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff2158-3b7a-4fc9-a910-83fe653b359c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:22.580962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbe80f-f8ca-42db-8ffd-3e7e56325856 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:22.593958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b33dd-228a-4ea4-9210-d0ca999d209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:22.594776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b33dd-228a-4ea4-9210-d0ca999d209b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.595055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b33dd-228a-4ea4-9210-d0ca999d209b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.595330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b33dd-228a-4ea4-9210-d0ca999d209b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.616658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b33dd-228a-4ea4-9210-d0ca999d209b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c96b33dd-228a-4ea4-9210-d0ca999d209b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:22.624570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:22.625509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:22.626356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 398/788] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:01:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:22.633017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cd524-2cff-41a6-b17b-7ed2cab3b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:22.633687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cd524-2cff-41a6-b17b-7ed2cab3b700 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.633968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cd524-2cff-41a6-b17b-7ed2cab3b700 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.634246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cd524-2cff-41a6-b17b-7ed2cab3b700 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.634992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cd524-2cff-41a6-b17b-7ed2cab3b700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:22.635291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cd524-2cff-41a6-b17b-7ed2cab3b700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:22.636709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cd524-2cff-41a6-b17b-7ed2cab3b700 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:22.637233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b33dd-228a-4ea4-9210-d0ca999d209b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:22.640217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:22.645812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:22.652464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 391/789] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:22.658591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cd524-2cff-41a6-b17b-7ed2cab3b700 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:22.834729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b33dd-228a-4ea4-9210-d0ca999d209b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:22.842430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cd524-2cff-41a6-b17b-7ed2cab3b700 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:22.877733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cabf9-5d74-49f7-ad57-e6082cc9ba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:22.878545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cabf9-5d74-49f7-ad57-e6082cc9ba3c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.878864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cabf9-5d74-49f7-ad57-e6082cc9ba3c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.879094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cabf9-5d74-49f7-ad57-e6082cc9ba3c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.886041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15a50a-911e-425a-a24a-2969daf21bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:22.886538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cabf9-5d74-49f7-ad57-e6082cc9ba3c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:22.887255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15a50a-911e-425a-a24a-2969daf21bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:22.887874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15a50a-911e-425a-a24a-2969daf21bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:22.888140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cabf9-5d74-49f7-ad57-e6082cc9ba3c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:22.888579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15a50a-911e-425a-a24a-2969daf21bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:22.889533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15a50a-911e-425a-a24a-2969daf21bd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:22.890051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15a50a-911e-425a-a24a-2969daf21bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:22.891656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15a50a-911e-425a-a24a-2969daf21bd0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:22.900366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 399/790] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:01:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-039cabf9-5d74-49f7-ad57-e6082cc9ba3c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:22.903617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:22.904558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:22.905519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:22.905519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:22.905519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:22.905519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:22.905519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:22.905519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:22.905519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:22.905519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:22.905519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 15:01:22.905519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:22.906049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15a50a-911e-425a-a24a-2969daf21bd0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:22.907880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 392/791] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:01:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:22.920612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cabf9-5d74-49f7-ad57-e6082cc9ba3c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:22.976138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:23.015942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:23.039543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15a50a-911e-425a-a24a-2969daf21bd0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:23.079818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb10bed-65e8-424b-a1b5-5304bf4e638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:23.079818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb10bed-65e8-424b-a1b5-5304bf4e638c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:23.079818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb10bed-65e8-424b-a1b5-5304bf4e638c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:23.079818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb10bed-65e8-424b-a1b5-5304bf4e638c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:23.087891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb10bed-65e8-424b-a1b5-5304bf4e638c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:23.089276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb10bed-65e8-424b-a1b5-5304bf4e638c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:23.096146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cabf9-5d74-49f7-ad57-e6082cc9ba3c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-fdb10bed-65e8-424b-a1b5-5304bf4e638c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:23.127166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:23.128439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:23.129330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:23.129330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:23.129330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:23.129330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:23.129330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 400/792] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:23.133716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d9ac7-1ecc-45c1-aac2-31c1ec4674b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:23.134636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d9ac7-1ecc-45c1-aac2-31c1ec4674b8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:23.135139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d9ac7-1ecc-45c1-aac2-31c1ec4674b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:23.135652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d9ac7-1ecc-45c1-aac2-31c1ec4674b8 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:23.136466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb10bed-65e8-424b-a1b5-5304bf4e638c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:23.136996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d9ac7-1ecc-45c1-aac2-31c1ec4674b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:23.137531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d9ac7-1ecc-45c1-aac2-31c1ec4674b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:23.139169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d9ac7-1ecc-45c1-aac2-31c1ec4674b8 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:23.160050 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 393/793] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 15:01:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:23.166075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d9ac7-1ecc-45c1-aac2-31c1ec4674b8 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:23.295442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb10bed-65e8-424b-a1b5-5304bf4e638c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:23.315995 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:23.360399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73376-acfb-4857-8bcc-8d69044317c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:23.361018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73376-acfb-4857-8bcc-8d69044317c7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:23.361313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73376-acfb-4857-8bcc-8d69044317c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:23.361601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73376-acfb-4857-8bcc-8d69044317c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:23.362356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73376-acfb-4857-8bcc-8d69044317c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:23.362669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73376-acfb-4857-8bcc-8d69044317c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:23.364202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73376-acfb-4857-8bcc-8d69044317c7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:23.392150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d9ac7-1ecc-45c1-aac2-31c1ec4674b8 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:23.407932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:23.410218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 401/794] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:23.420574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73376-acfb-4857-8bcc-8d69044317c7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:23.431498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ae9c3-1811-42ce-887d-c787bda429f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:23.433405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ae9c3-1811-42ce-887d-c787bda429f5 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:23.433899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ae9c3-1811-42ce-887d-c787bda429f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:23.434346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ae9c3-1811-42ce-887d-c787bda429f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:23.446359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ae9c3-1811-42ce-887d-c787bda429f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:23.448236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ae9c3-1811-42ce-887d-c787bda429f5 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-9d5ae9c3-1811-42ce-887d-c787bda429f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:23.468171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:23.469091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:23.470000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:23.470000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:23.470000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:23.470000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:23.472402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 394/795] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:23.474380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48b8b-f858-41e7-ae24-3d9270de0904 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:23.475077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48b8b-f858-41e7-ae24-3d9270de0904 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:23.475762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48b8b-f858-41e7-ae24-3d9270de0904 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:23.477713 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 395/796] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:23.478590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf48b8b-f858-41e7-ae24-3d9270de0904 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:23.547746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73376-acfb-4857-8bcc-8d69044317c7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:23.586169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e91d2c-026b-4069-9407-cf8eca2ab774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:23.586992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e91d2c-026b-4069-9407-cf8eca2ab774 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:23.587319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e91d2c-026b-4069-9407-cf8eca2ab774 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:23.587626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e91d2c-026b-4069-9407-cf8eca2ab774 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:23.595286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e91d2c-026b-4069-9407-cf8eca2ab774 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:23.597205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e91d2c-026b-4069-9407-cf8eca2ab774 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:23.604624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf48b8b-f858-41e7-ae24-3d9270de0904 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-89e91d2c-026b-4069-9407-cf8eca2ab774 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:23.614629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:23.615604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:23.616663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:23.616663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:23.616663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:23.616663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:23.616663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:23.616663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:23.616663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:23.616663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:23.616663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 15:01:23.616663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:23.616663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 402/797] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 15:01:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:23.617740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa41c21-7ccf-4563-8cf2-95dbd6f417b5 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:23.617833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa41c21-7ccf-4563-8cf2-95dbd6f417b5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:23.618039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa41c21-7ccf-4563-8cf2-95dbd6f417b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:23.637105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6aa41c21-7ccf-4563-8cf2-95dbd6f417b5 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:23.638489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6aa41c21-7ccf-4563-8cf2-95dbd6f417b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:23.647260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25a6a9-69c1-4581-a8c9-a9969a635217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:23.648258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25a6a9-69c1-4581-a8c9-a9969a635217 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:23.649058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25a6a9-69c1-4581-a8c9-a9969a635217 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:23.649531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25a6a9-69c1-4581-a8c9-a9969a635217 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:23.650906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25a6a9-69c1-4581-a8c9-a9969a635217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:23.651488 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25a6a9-69c1-4581-a8c9-a9969a635217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:23.653267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25a6a9-69c1-4581-a8c9-a9969a635217 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:23.670005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 396/798] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:23.670511 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:23.671612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25a6a9-69c1-4581-a8c9-a9969a635217 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:23.699848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:23.791869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25a6a9-69c1-4581-a8c9-a9969a635217 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:23.829732 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d07da2-ea42-4474-9e03-fc9c5b4dd19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:23.830719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d07da2-ea42-4474-9e03-fc9c5b4dd19a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:23.831060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d07da2-ea42-4474-9e03-fc9c5b4dd19a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:23.831421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d07da2-ea42-4474-9e03-fc9c5b4dd19a None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:23.832326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d07da2-ea42-4474-9e03-fc9c5b4dd19a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:23.832635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d07da2-ea42-4474-9e03-fc9c5b4dd19a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:23.834088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d07da2-ea42-4474-9e03-fc9c5b4dd19a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:23.855644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 403/799] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:23.857046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa41c21-7ccf-4563-8cf2-95dbd6f417b5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:23.862797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 397/800] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 15:01:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:23.869353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d07da2-ea42-4474-9e03-fc9c5b4dd19a None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:23.958807 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:23.971411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa41c21-7ccf-4563-8cf2-95dbd6f417b5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:23.982565 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d07da2-ea42-4474-9e03-fc9c5b4dd19a None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:24.005942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ff063-78b6-4242-80ba-1d81dd1df0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:24.006745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ff063-78b6-4242-80ba-1d81dd1df0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.007025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ff063-78b6-4242-80ba-1d81dd1df0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.007295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ff063-78b6-4242-80ba-1d81dd1df0f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.014277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ff063-78b6-4242-80ba-1d81dd1df0f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:24.015752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ff063-78b6-4242-80ba-1d81dd1df0f4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:24.018707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bde5f-5bd8-4426-ac6c-502506ea6702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:24.019514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bde5f-5bd8-4426-ac6c-502506ea6702 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.019841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bde5f-5bd8-4426-ac6c-502506ea6702 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.020121 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bde5f-5bd8-4426-ac6c-502506ea6702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b41ff063-78b6-4242-80ba-1d81dd1df0f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:24.029648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:24.030503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:24.031417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:24.031417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:24.031417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:24.031417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:24.031417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:24.031417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:24.031417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:24.031417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:24.031417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 404/801] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:24.031929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ff063-78b6-4242-80ba-1d81dd1df0f4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:24.037408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bde5f-5bd8-4426-ac6c-502506ea6702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:24.038885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165bde5f-5bd8-4426-ac6c-502506ea6702 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-165bde5f-5bd8-4426-ac6c-502506ea6702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:24.057392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:24.058381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:24.059276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:24.059276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:24.059276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:24.059276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:24.062209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:24.063684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 398/802] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:24.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf314-d3d9-4315-b9cc-59687ea0f451 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.065203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf314-d3d9-4315-b9cc-59687ea0f451 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.065471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf314-d3d9-4315-b9cc-59687ea0f451 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.071220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 399/803] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:24.072086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bf314-d3d9-4315-b9cc-59687ea0f451 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:24.143575 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ff063-78b6-4242-80ba-1d81dd1df0f4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:24.177917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edddc6e-4840-44da-bc00-a3eb812c3a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:24.178724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edddc6e-4840-44da-bc00-a3eb812c3a2b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.179056 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edddc6e-4840-44da-bc00-a3eb812c3a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.179347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edddc6e-4840-44da-bc00-a3eb812c3a2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.183214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bf314-d3d9-4315-b9cc-59687ea0f451 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:24.190124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edddc6e-4840-44da-bc00-a3eb812c3a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9edddc6e-4840-44da-bc00-a3eb812c3a2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:24.197885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:24.198803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:24.199666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 405/804] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:01:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:24.200451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edddc6e-4840-44da-bc00-a3eb812c3a2b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:24.220764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:24.228691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121d158-9f78-490a-bb8c-156e849c2df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:24.230016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121d158-9f78-490a-bb8c-156e849c2df9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.230299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121d158-9f78-490a-bb8c-156e849c2df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.230625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121d158-9f78-490a-bb8c-156e849c2df9 None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.231629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121d158-9f78-490a-bb8c-156e849c2df9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:24.231847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121d158-9f78-490a-bb8c-156e849c2df9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:24.233257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121d158-9f78-490a-bb8c-156e849c2df9 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:24.250912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 400/805] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:24.250912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361829e4-2ce7-4e5a-a292-9f06b718ae81 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.250912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361829e4-2ce7-4e5a-a292-9f06b718ae81 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.250912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361829e4-2ce7-4e5a-a292-9f06b718ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.267772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-361829e4-2ce7-4e5a-a292-9f06b718ae81 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:24.268852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-361829e4-2ce7-4e5a-a292-9f06b718ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:24.291709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:24.308254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edddc6e-4840-44da-bc00-a3eb812c3a2b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:24.336213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 401/806] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:24.337054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361829e4-2ce7-4e5a-a292-9f06b718ae81 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:24.341711 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d653c1-f102-4059-9a0a-08e94a83aecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:24.342377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d653c1-f102-4059-9a0a-08e94a83aecc None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.342657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d653c1-f102-4059-9a0a-08e94a83aecc None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.342933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d653c1-f102-4059-9a0a-08e94a83aecc None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.343685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d653c1-f102-4059-9a0a-08e94a83aecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:24.343991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d653c1-f102-4059-9a0a-08e94a83aecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:24.345365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d653c1-f102-4059-9a0a-08e94a83aecc None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:24.357315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 406/807] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:24.358248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d653c1-f102-4059-9a0a-08e94a83aecc None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:24.449447 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361829e4-2ce7-4e5a-a292-9f06b718ae81 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:24.453982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d653c1-f102-4059-9a0a-08e94a83aecc None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:24.468191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:24.483511 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156228e6-f6e5-4b37-b94d-8eb132143c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:24.484210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156228e6-f6e5-4b37-b94d-8eb132143c56 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.484489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156228e6-f6e5-4b37-b94d-8eb132143c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.484759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156228e6-f6e5-4b37-b94d-8eb132143c56 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.485511 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156228e6-f6e5-4b37-b94d-8eb132143c56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:24.485817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156228e6-f6e5-4b37-b94d-8eb132143c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:24.486270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97c7bc-82ba-48cc-af69-e2a6b230f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:24.487159 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97c7bc-82ba-48cc-af69-e2a6b230f2da None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.487258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156228e6-f6e5-4b37-b94d-8eb132143c56 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:24.487439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97c7bc-82ba-48cc-af69-e2a6b230f2da None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.487741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97c7bc-82ba-48cc-af69-e2a6b230f2da None admin] PATH_INFO: `/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/1643cf33cd3b417bb2cd15b5503f7ffd/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.489664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97c7bc-82ba-48cc-af69-e2a6b230f2da None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ad2e4552f43f09ebf85b6c82a5481, user_id=1643cf33cd3b417bb2cd15b5503f7ffd, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:24.491068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97c7bc-82ba-48cc-af69-e2a6b230f2da None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:24.495120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 402/808] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:01:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:24.496688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b899de-9b32-4c38-896b-995656e4640a None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.496982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b899de-9b32-4c38-896b-995656e4640a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.497350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b899de-9b32-4c38-896b-995656e4640a None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.498838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 403/809] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:24.499582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b899de-9b32-4c38-896b-995656e4640a None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:24.508302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 407/810] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:01:24 2022] PUT /identity/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/1643cf33cd3b417bb2cd15b5503f7ffd/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:24.509158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97c7bc-82ba-48cc-af69-e2a6b230f2da None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:24.527516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:24.614293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b899de-9b32-4c38-896b-995656e4640a None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:24.636036 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97c7bc-82ba-48cc-af69-e2a6b230f2da None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:24.654567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8893ed7-c8ca-4d19-abb6-31823fcdf995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:24.655440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8893ed7-c8ca-4d19-abb6-31823fcdf995 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.655781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8893ed7-c8ca-4d19-abb6-31823fcdf995 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.656023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8893ed7-c8ca-4d19-abb6-31823fcdf995 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.656702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8893ed7-c8ca-4d19-abb6-31823fcdf995 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:24.658106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8893ed7-c8ca-4d19-abb6-31823fcdf995 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-b8893ed7-c8ca-4d19-abb6-31823fcdf995 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:24.671964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:24.673199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:24.674072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 404/811] 10.222.0.24 () {56 vars in 1129 bytes} [Wed May 25 15:01:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:24.674913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8893ed7-c8ca-4d19-abb6-31823fcdf995 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:24.681974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605086f3-d900-474d-8ae3-8d2aa3307d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:24.682846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605086f3-d900-474d-8ae3-8d2aa3307d02 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.683135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605086f3-d900-474d-8ae3-8d2aa3307d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.683408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605086f3-d900-474d-8ae3-8d2aa3307d02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.693476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605086f3-d900-474d-8ae3-8d2aa3307d02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:24.694728 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605086f3-d900-474d-8ae3-8d2aa3307d02 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-605086f3-d900-474d-8ae3-8d2aa3307d02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:24.711162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:24.712312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:24.713337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:24.713337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:24.713337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:24.713337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:24.713337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:24.713337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:24.713337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:24.713337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:24.713337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 408/812] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:24.713894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bd664-6562-4b8c-a82a-46718f3bc034 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.713894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bd664-6562-4b8c-a82a-46718f3bc034 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.714116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bd664-6562-4b8c-a82a-46718f3bc034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.731632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f04bd664-6562-4b8c-a82a-46718f3bc034 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:24.732878 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f04bd664-6562-4b8c-a82a-46718f3bc034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:24.737642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:24.793361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8893ed7-c8ca-4d19-abb6-31823fcdf995 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:24.799547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:24.808002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 409/813] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:24.815909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bd664-6562-4b8c-a82a-46718f3bc034 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:24.829813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf5dc1-ba83-41cb-804a-71eaed30553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:24.830624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf5dc1-ba83-41cb-804a-71eaed30553e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.830909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf5dc1-ba83-41cb-804a-71eaed30553e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.831214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf5dc1-ba83-41cb-804a-71eaed30553e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.842491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf5dc1-ba83-41cb-804a-71eaed30553e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:24.843990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf5dc1-ba83-41cb-804a-71eaed30553e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-1fcf5dc1-ba83-41cb-804a-71eaed30553e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:24.861726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:24.862850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:24.863781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:24.863781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:24.863781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:24.863781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:24.863781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 405/814] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:24.863781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf5dc1-ba83-41cb-804a-71eaed30553e None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:24.935691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bd664-6562-4b8c-a82a-46718f3bc034 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:24.965958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:24.969885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf5dc1-ba83-41cb-804a-71eaed30553e None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:24.976119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204ecfb-bed8-4fd0-b536-11fe978e479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:24.976805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ecfb-bed8-4fd0-b536-11fe978e479d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:24.977140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ecfb-bed8-4fd0-b536-11fe978e479d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:24.977930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ecfb-bed8-4fd0-b536-11fe978e479d None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:24.978661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204ecfb-bed8-4fd0-b536-11fe978e479d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:24.978977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204ecfb-bed8-4fd0-b536-11fe978e479d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:24.981300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204ecfb-bed8-4fd0-b536-11fe978e479d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:24.987253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 410/815] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 15:01:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:24.988095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204ecfb-bed8-4fd0-b536-11fe978e479d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:25.011773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ec36a-067f-4157-85cb-c6d6f9267170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:25.012605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ec36a-067f-4157-85cb-c6d6f9267170 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:25.012893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ec36a-067f-4157-85cb-c6d6f9267170 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:25.013232 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ec36a-067f-4157-85cb-c6d6f9267170 None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:25.014030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ec36a-067f-4157-85cb-c6d6f9267170 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:25.014342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ec36a-067f-4157-85cb-c6d6f9267170 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:25.015810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ec36a-067f-4157-85cb-c6d6f9267170 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:25.033632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 406/816] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:25.033632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ec36a-067f-4157-85cb-c6d6f9267170 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:25.054996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:25.095576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204ecfb-bed8-4fd0-b536-11fe978e479d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:25.132227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fe70f-614f-426b-8261-c3d04fcdf772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:25.133118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fe70f-614f-426b-8261-c3d04fcdf772 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:25.133479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fe70f-614f-426b-8261-c3d04fcdf772 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:25.133823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fe70f-614f-426b-8261-c3d04fcdf772 None admin] PATH_INFO: `/v3/services/network` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:25.134612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fe70f-614f-426b-8261-c3d04fcdf772 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:25.136094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fe70f-614f-426b-8261-c3d04fcdf772 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:25.138555 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ec36a-067f-4157-85cb-c6d6f9267170 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3a5fe70f-614f-426b-8261-c3d04fcdf772 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:25.152922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:25.159141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:25.160573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 411/817] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:24 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:25.161571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fe70f-614f-426b-8261-c3d04fcdf772 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:25.183379 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25968c6-d991-4852-97f3-29ad48b74a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:25.184083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25968c6-d991-4852-97f3-29ad48b74a53 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:25.184366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25968c6-d991-4852-97f3-29ad48b74a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:25.184650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25968c6-d991-4852-97f3-29ad48b74a53 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:25.185399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25968c6-d991-4852-97f3-29ad48b74a53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:25.185773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25968c6-d991-4852-97f3-29ad48b74a53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:25.187071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25968c6-d991-4852-97f3-29ad48b74a53 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:25.202869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 407/818] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:25.202869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25968c6-d991-4852-97f3-29ad48b74a53 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:25.222326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:25.264643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fe70f-614f-426b-8261-c3d04fcdf772 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:25.289691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:25.300829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064682dc-13a9-4414-803d-96bebd473c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:25.301730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064682dc-13a9-4414-803d-96bebd473c36 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:25.302234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064682dc-13a9-4414-803d-96bebd473c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:25.302598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064682dc-13a9-4414-803d-96bebd473c36 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:25.303409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064682dc-13a9-4414-803d-96bebd473c36 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:25.303834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064682dc-13a9-4414-803d-96bebd473c36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:25.305568 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064682dc-13a9-4414-803d-96bebd473c36 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:25.316598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25968c6-d991-4852-97f3-29ad48b74a53 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:25.316819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 412/819] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 15:01:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:25.316819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064682dc-13a9-4414-803d-96bebd473c36 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:25.348084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d27b8-080e-4782-b5c9-ed7b3702faa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:25.349337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d27b8-080e-4782-b5c9-ed7b3702faa6 None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:25.349707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d27b8-080e-4782-b5c9-ed7b3702faa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:25.350070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d27b8-080e-4782-b5c9-ed7b3702faa6 None admin] PATH_INFO: `/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/042393fa408b45208021befccd6bd800/roles/4e05103edb314958aba7aa66c8747306` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:25.365819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d27b8-080e-4782-b5c9-ed7b3702faa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ad2e4552f43f09ebf85b6c82a5481, user_id=042393fa408b45208021befccd6bd800, role_id=4e05103edb314958aba7aa66c8747306)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:25.367527 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d27b8-080e-4782-b5c9-ed7b3702faa6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:25.382026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 408/820] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:01:25 2022] PUT /identity/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/042393fa408b45208021befccd6bd800/roles/4e05103edb314958aba7aa66c8747306 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:25.382839 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d27b8-080e-4782-b5c9-ed7b3702faa6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:25.440991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064682dc-13a9-4414-803d-96bebd473c36 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:25.467645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:25.487319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975248dc-fdf2-4030-b64c-f157be165f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:25.488431 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975248dc-fdf2-4030-b64c-f157be165f7b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:25.488557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975248dc-fdf2-4030-b64c-f157be165f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:25.488914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975248dc-fdf2-4030-b64c-f157be165f7b None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:25.489756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975248dc-fdf2-4030-b64c-f157be165f7b None admin] RBAC: Adding query filter params (name=network) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:25.490131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975248dc-fdf2-4030-b64c-f157be165f7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:25.491798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975248dc-fdf2-4030-b64c-f157be165f7b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:25.501869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 413/821] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:25.501869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975248dc-fdf2-4030-b64c-f157be165f7b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:25.514503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d27b8-080e-4782-b5c9-ed7b3702faa6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:25.553422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb7967-7adb-44de-b8c5-89e3ba814ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:25.554648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb7967-7adb-44de-b8c5-89e3ba814ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:25.555083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb7967-7adb-44de-b8c5-89e3ba814ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:25.555636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb7967-7adb-44de-b8c5-89e3ba814ae2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:25.558910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:25.566654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb7967-7adb-44de-b8c5-89e3ba814ae2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:25.568596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb7967-7adb-44de-b8c5-89e3ba814ae2 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-11eb7967-7adb-44de-b8c5-89e3ba814ae2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:25.584774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:25.585954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:25.587120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:25.587120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:25.587120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:25.587120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:25.587120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:25.587120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:25.587120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:25.587120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:25.587120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:01:25.587120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:25.591729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 409/822] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 15:01:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:25.592717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb7967-7adb-44de-b8c5-89e3ba814ae2 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:25.619885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975248dc-fdf2-4030-b64c-f157be165f7b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:25.660961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f0fe6-68fe-41f1-89ed-2bf74258d0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:25.661602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f0fe6-68fe-41f1-89ed-2bf74258d0f3 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:25.662389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f0fe6-68fe-41f1-89ed-2bf74258d0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:25.662389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f0fe6-68fe-41f1-89ed-2bf74258d0f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:25.663009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f0fe6-68fe-41f1-89ed-2bf74258d0f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:25.665539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f0fe6-68fe-41f1-89ed-2bf74258d0f3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:25.693080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 414/823] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 15:01:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:25.693934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f0fe6-68fe-41f1-89ed-2bf74258d0f3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:25.756926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb7967-7adb-44de-b8c5-89e3ba814ae2 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:25.807236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:25.833221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153611c-a72d-45b7-8e10-70b93f006a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:25.833912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153611c-a72d-45b7-8e10-70b93f006a0e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:25.834201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153611c-a72d-45b7-8e10-70b93f006a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:25.834482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153611c-a72d-45b7-8e10-70b93f006a0e None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:25.835216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153611c-a72d-45b7-8e10-70b93f006a0e None admin] RBAC: Adding query filter params (type=network) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:25.835531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153611c-a72d-45b7-8e10-70b93f006a0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:25.836967 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153611c-a72d-45b7-8e10-70b93f006a0e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:25.850543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 410/824] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:25.857695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153611c-a72d-45b7-8e10-70b93f006a0e None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:25.901960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f0fe6-68fe-41f1-89ed-2bf74258d0f3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:25.914096 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:25.945131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de3a01-4df0-4356-8c56-be256c0b824e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:25.946176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de3a01-4df0-4356-8c56-be256c0b824e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:25.946658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de3a01-4df0-4356-8c56-be256c0b824e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:25.947157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de3a01-4df0-4356-8c56-be256c0b824e None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:25.949207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de3a01-4df0-4356-8c56-be256c0b824e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:25.949729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de3a01-4df0-4356-8c56-be256c0b824e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:25.951522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de3a01-4df0-4356-8c56-be256c0b824e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:25.977076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 415/825] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 15:01:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:25.984748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de3a01-4df0-4356-8c56-be256c0b824e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:26.008092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153611c-a72d-45b7-8e10-70b93f006a0e None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:26.046723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fea0af-adb4-4a9b-bcf1-6f5b0dc4022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:26.047393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fea0af-adb4-4a9b-bcf1-6f5b0dc4022d None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:26.047703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fea0af-adb4-4a9b-bcf1-6f5b0dc4022d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:26.047979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fea0af-adb4-4a9b-bcf1-6f5b0dc4022d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:26.048745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fea0af-adb4-4a9b-bcf1-6f5b0dc4022d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:26.050254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fea0af-adb4-4a9b-bcf1-6f5b0dc4022d None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:26.083588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 411/826] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 15:01:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:26.111394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de3a01-4df0-4356-8c56-be256c0b824e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:26.158374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497091e-e21e-4a2a-967b-924e91ce0ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:26.159096 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497091e-e21e-4a2a-967b-924e91ce0ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:26.159385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497091e-e21e-4a2a-967b-924e91ce0ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:26.159689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497091e-e21e-4a2a-967b-924e91ce0ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:26.195151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:26.236770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497091e-e21e-4a2a-967b-924e91ce0ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:26.238318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497091e-e21e-4a2a-967b-924e91ce0ef0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:26.346109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 416/827] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:25 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:01:26.351939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fea0af-adb4-4a9b-bcf1-6f5b0dc4022d None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:26.409556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:26.485567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fea0af-adb4-4a9b-bcf1-6f5b0dc4022d None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:26.527532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1a2be-46f4-4a33-8e68-a382f9d31254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:26.528404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1a2be-46f4-4a33-8e68-a382f9d31254 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:26.528699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1a2be-46f4-4a33-8e68-a382f9d31254 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:26.528980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1a2be-46f4-4a33-8e68-a382f9d31254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:26.541345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1a2be-46f4-4a33-8e68-a382f9d31254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:26.542811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1a2be-46f4-4a33-8e68-a382f9d31254 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-50c1a2be-46f4-4a33-8e68-a382f9d31254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:26.560010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:26.561123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:26.562356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:26.562356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:26.562356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:26.562356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:26.562356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 412/828] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:26.568959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497091e-e21e-4a2a-967b-924e91ce0ef0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:26.636034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:26.684342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497091e-e21e-4a2a-967b-924e91ce0ef0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:26.724888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db74ce-61a7-4b12-b66b-139fc07cf13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:26.725954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db74ce-61a7-4b12-b66b-139fc07cf13f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:26.726476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db74ce-61a7-4b12-b66b-139fc07cf13f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:26.726962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db74ce-61a7-4b12-b66b-139fc07cf13f None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:26.727931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db74ce-61a7-4b12-b66b-139fc07cf13f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:26.728442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db74ce-61a7-4b12-b66b-139fc07cf13f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:26.730002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db74ce-61a7-4b12-b66b-139fc07cf13f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:26.746965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 417/829] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:26.748695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1a2be-46f4-4a33-8e68-a382f9d31254 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:26.849201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:26.856724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1a2be-46f4-4a33-8e68-a382f9d31254 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:26.875318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a270a-40bd-48e5-a1ca-2cf2a2126dd2 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:26.875659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a270a-40bd-48e5-a1ca-2cf2a2126dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:26.876024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a270a-40bd-48e5-a1ca-2cf2a2126dd2 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:26.877566 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 418/830] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:26.883851 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c4f3e-9127-4a19-8f42-39a6c29e7d35 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:26.884146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c4f3e-9127-4a19-8f42-39a6c29e7d35 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:26.884435 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c4f3e-9127-4a19-8f42-39a6c29e7d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:26.898248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7941b7-872c-4ca2-b416-f03162da3b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:26.899370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7941b7-872c-4ca2-b416-f03162da3b45 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:26.899881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7941b7-872c-4ca2-b416-f03162da3b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:26.900380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7941b7-872c-4ca2-b416-f03162da3b45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:26.901502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-009c4f3e-9127-4a19-8f42-39a6c29e7d35 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:26.902882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-009c4f3e-9127-4a19-8f42-39a6c29e7d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:26.909708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7941b7-872c-4ca2-b416-f03162da3b45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:26.912240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7941b7-872c-4ca2-b416-f03162da3b45 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-8e7941b7-872c-4ca2-b416-f03162da3b45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:26.932442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:26.933397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:26.934316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:26.934316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:26.934316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:26.934316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:26.934316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:26.934316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:26.934316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:26.934316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:26.937299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 413/831] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:26.942631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7941b7-872c-4ca2-b416-f03162da3b45 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:26.988282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 419/832] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:27.011446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c4f3e-9127-4a19-8f42-39a6c29e7d35 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:27.053245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7941b7-872c-4ca2-b416-f03162da3b45 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:27.077805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:27.097367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa9d30-7ead-4ff5-a1f7-bcaaf342e517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:27.098312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa9d30-7ead-4ff5-a1f7-bcaaf342e517 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:27.098764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa9d30-7ead-4ff5-a1f7-bcaaf342e517 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:27.099185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa9d30-7ead-4ff5-a1f7-bcaaf342e517 None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:27.100163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa9d30-7ead-4ff5-a1f7-bcaaf342e517 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:27.100622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa9d30-7ead-4ff5-a1f7-bcaaf342e517 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:27.102651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa9d30-7ead-4ff5-a1f7-bcaaf342e517 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:27.118579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 414/833] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:27.124548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa9d30-7ead-4ff5-a1f7-bcaaf342e517 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:27.131752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c4f3e-9127-4a19-8f42-39a6c29e7d35 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:27.148583 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:27.168507 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1e2f9-ee7d-4ba5-b455-647e3826324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:27.169353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1e2f9-ee7d-4ba5-b455-647e3826324b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:27.169639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1e2f9-ee7d-4ba5-b455-647e3826324b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:27.169917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1e2f9-ee7d-4ba5-b455-647e3826324b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:27.180819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1e2f9-ee7d-4ba5-b455-647e3826324b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-cbe1e2f9-ee7d-4ba5-b455-647e3826324b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:27.189161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:27.190152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:27.191010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:27.191010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:27.191010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:27.191010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:27.191010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:27.191010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:27.191010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:27.191010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:27.191010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:27.191010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:27.191010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:27.191010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:27.195204 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 420/834] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:01:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:27.196386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1e2f9-ee7d-4ba5-b455-647e3826324b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:27.262119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa9d30-7ead-4ff5-a1f7-bcaaf342e517 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:27.305661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1e2f9-ee7d-4ba5-b455-647e3826324b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:27.308156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4a69e-45da-412f-bfeb-06c1b146cc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:27.309924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4a69e-45da-412f-bfeb-06c1b146cc11 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:27.310376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4a69e-45da-412f-bfeb-06c1b146cc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:27.310863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4a69e-45da-412f-bfeb-06c1b146cc11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:27.311904 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4a69e-45da-412f-bfeb-06c1b146cc11 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=f553cee02ab345dabbef807bfe85544a) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:27.312370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4a69e-45da-412f-bfeb-06c1b146cc11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:27.314498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4a69e-45da-412f-bfeb-06c1b146cc11 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:27.320845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:27.324062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 415/835] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:27 2022] GET /identity/v3/role_assignments?user.id=f553cee02ab345dabbef807bfe85544a&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:27.350120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cd13c-97ee-4410-99a6-fd384eb8e228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:27.351130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cd13c-97ee-4410-99a6-fd384eb8e228 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:27.351606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cd13c-97ee-4410-99a6-fd384eb8e228 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:27.352034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cd13c-97ee-4410-99a6-fd384eb8e228 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:27.352973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cd13c-97ee-4410-99a6-fd384eb8e228 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:27.353434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cd13c-97ee-4410-99a6-fd384eb8e228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:27.355012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cd13c-97ee-4410-99a6-fd384eb8e228 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:27.365908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 421/836] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:01:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:27.371868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4a69e-45da-412f-bfeb-06c1b146cc11 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:27.467497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:27.488636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4a69e-45da-412f-bfeb-06c1b146cc11 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:27.525051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056039e-5f93-4ebf-b080-ddd381f2238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:27.525870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056039e-5f93-4ebf-b080-ddd381f2238e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:27.526158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056039e-5f93-4ebf-b080-ddd381f2238e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:27.526439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056039e-5f93-4ebf-b080-ddd381f2238e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:27.538401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056039e-5f93-4ebf-b080-ddd381f2238e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:27.539898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056039e-5f93-4ebf-b080-ddd381f2238e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-8056039e-5f93-4ebf-b080-ddd381f2238e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:27.557465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:27.558420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:27.559337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:27.559337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:27.559337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:27.559337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:27.559337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 416/837] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:27.566925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cd13c-97ee-4410-99a6-fd384eb8e228 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:27.677705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cd13c-97ee-4410-99a6-fd384eb8e228 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:27.714672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4afd7f-ef3b-414e-8fb5-7f8536cfa2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:27.715292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4afd7f-ef3b-414e-8fb5-7f8536cfa2fd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:27.715607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4afd7f-ef3b-414e-8fb5-7f8536cfa2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:27.715891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4afd7f-ef3b-414e-8fb5-7f8536cfa2fd None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:27.716638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4afd7f-ef3b-414e-8fb5-7f8536cfa2fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:27.716948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4afd7f-ef3b-414e-8fb5-7f8536cfa2fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:27.718427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4afd7f-ef3b-414e-8fb5-7f8536cfa2fd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:27.731581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 422/838] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:27.742159 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056039e-5f93-4ebf-b080-ddd381f2238e None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:27.777816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033ee3-c80f-4bf3-b2e6-f3c428cb6594 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:27.778106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033ee3-c80f-4bf3-b2e6-f3c428cb6594 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:27.778385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033ee3-c80f-4bf3-b2e6-f3c428cb6594 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:27.780444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 423/839] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:27.788433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d013f2-edb9-47ea-954b-9bad1fb364f0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:27.788841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d013f2-edb9-47ea-954b-9bad1fb364f0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:27.789223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d013f2-edb9-47ea-954b-9bad1fb364f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:27.807390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e3d013f2-edb9-47ea-954b-9bad1fb364f0 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:27.808788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e3d013f2-edb9-47ea-954b-9bad1fb364f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:27.841347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:27.866187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056039e-5f93-4ebf-b080-ddd381f2238e None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:27.880288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 424/840] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:27.903351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d013f2-edb9-47ea-954b-9bad1fb364f0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:27.915320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:27.922152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e4596-c3e0-467b-af57-1f6bc4304dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:27.923100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e4596-c3e0-467b-af57-1f6bc4304dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:27.923760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e4596-c3e0-467b-af57-1f6bc4304dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:27.924159 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e4596-c3e0-467b-af57-1f6bc4304dc3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:27.934566 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e4596-c3e0-467b-af57-1f6bc4304dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:27.937052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e4596-c3e0-467b-af57-1f6bc4304dc3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-786e4596-c3e0-467b-af57-1f6bc4304dc3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:27.954754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:27.956033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:27.957067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:27.957067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:27.957067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:27.957067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:27.957067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:27.957067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:27.957067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:27.957067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:27.957067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 15:01:27.957067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:27.959533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 417/841] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:01:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:27.964893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e4596-c3e0-467b-af57-1f6bc4304dc3 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:28.035026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d013f2-edb9-47ea-954b-9bad1fb364f0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:28.085937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c4d10-9968-4169-aa5f-9d9b0a3e5323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:28.087031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c4d10-9968-4169-aa5f-9d9b0a3e5323 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.087498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c4d10-9968-4169-aa5f-9d9b0a3e5323 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.087934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c4d10-9968-4169-aa5f-9d9b0a3e5323 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.098798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e4596-c3e0-467b-af57-1f6bc4304dc3 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:28.100566 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c4d10-9968-4169-aa5f-9d9b0a3e5323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ac7c4d10-9968-4169-aa5f-9d9b0a3e5323 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:28.108942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:28.109938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:28.110812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:28.110812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:28.110812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:28.110812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:28.110812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:28.110812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:28.110812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:28.110812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:28.110812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:28.110812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:28.110812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:01:28.110812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:28.113862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 425/842] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:01:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:28.120400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c4d10-9968-4169-aa5f-9d9b0a3e5323 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:28.148880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ba549-593b-4bcc-827a-c194b6c8c425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:28.149577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ba549-593b-4bcc-827a-c194b6c8c425 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.149861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ba549-593b-4bcc-827a-c194b6c8c425 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.150135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ba549-593b-4bcc-827a-c194b6c8c425 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.151081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ba549-593b-4bcc-827a-c194b6c8c425 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:28.151304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ba549-593b-4bcc-827a-c194b6c8c425 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:28.152794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ba549-593b-4bcc-827a-c194b6c8c425 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:28.160824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:28.178758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 418/843] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 15:01:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:28.185010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ba549-593b-4bcc-827a-c194b6c8c425 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:28.246775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c4d10-9968-4169-aa5f-9d9b0a3e5323 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:28.252266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:28.284915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f26a43-b6c6-45ab-a986-cd54b0948d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:28.285927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26a43-b6c6-45ab-a986-cd54b0948d19 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.286661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26a43-b6c6-45ab-a986-cd54b0948d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.287029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26a43-b6c6-45ab-a986-cd54b0948d19 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.287932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f26a43-b6c6-45ab-a986-cd54b0948d19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:28.288335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f26a43-b6c6-45ab-a986-cd54b0948d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:28.289903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f26a43-b6c6-45ab-a986-cd54b0948d19 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:28.304171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 426/844] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:01:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:28.306029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f26a43-b6c6-45ab-a986-cd54b0948d19 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:28.321005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ba549-593b-4bcc-827a-c194b6c8c425 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:28.359440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7134ff8-6a4f-4686-b7b7-76eb57969cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:28.360562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7134ff8-6a4f-4686-b7b7-76eb57969cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.360848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7134ff8-6a4f-4686-b7b7-76eb57969cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.361390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7134ff8-6a4f-4686-b7b7-76eb57969cc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.391199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:28.405848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f26a43-b6c6-45ab-a986-cd54b0948d19 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:28.449518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7134ff8-6a4f-4686-b7b7-76eb57969cc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:28.449518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7134ff8-6a4f-4686-b7b7-76eb57969cc3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:28.458277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fee2dc-aa92-49bc-aebc-7b08c31057ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:28.459329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fee2dc-aa92-49bc-aebc-7b08c31057ef None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.459843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fee2dc-aa92-49bc-aebc-7b08c31057ef None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.460292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fee2dc-aa92-49bc-aebc-7b08c31057ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.471375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fee2dc-aa92-49bc-aebc-7b08c31057ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:28.473084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fee2dc-aa92-49bc-aebc-7b08c31057ef None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-d3fee2dc-aa92-49bc-aebc-7b08c31057ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:28.490394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:28.491317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:28.493193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:28.493193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:28.493193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:28.493193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:28.493193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 427/845] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:28.493193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e80ea0-7a17-4b6f-9e4d-bb22ca0d7327 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.493193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e80ea0-7a17-4b6f-9e4d-bb22ca0d7327 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.493629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e80ea0-7a17-4b6f-9e4d-bb22ca0d7327 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.495598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 428/846] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:28.496907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e80ea0-7a17-4b6f-9e4d-bb22ca0d7327 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:28.508091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:28.566544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 419/847] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:01:28.568241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d514c8-12a9-43bc-9cc2-7b555e4d5a6a None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.568684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d514c8-12a9-43bc-9cc2-7b555e4d5a6a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.569107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d514c8-12a9-43bc-9cc2-7b555e4d5a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.587225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-01d514c8-12a9-43bc-9cc2-7b555e4d5a6a None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:28.588799 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-01d514c8-12a9-43bc-9cc2-7b555e4d5a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:28.606712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e80ea0-7a17-4b6f-9e4d-bb22ca0d7327 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:28.643094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ebf7-e9a9-4e4e-9724-60daa849a8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:28.643800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ebf7-e9a9-4e4e-9724-60daa849a8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.644084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ebf7-e9a9-4e4e-9724-60daa849a8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.644362 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ebf7-e9a9-4e4e-9724-60daa849a8f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.645492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ebf7-e9a9-4e4e-9724-60daa849a8f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:28.645824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ebf7-e9a9-4e4e-9724-60daa849a8f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:28.647434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ebf7-e9a9-4e4e-9724-60daa849a8f9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:28.657228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:28.658781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 420/848] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:28.659758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d514c8-12a9-43bc-9cc2-7b555e4d5a6a None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:28.671135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 429/849] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:28.672326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ebf7-e9a9-4e4e-9724-60daa849a8f9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:28.748577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:28.769723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d514c8-12a9-43bc-9cc2-7b555e4d5a6a None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:28.776659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ebf7-e9a9-4e4e-9724-60daa849a8f9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:28.806119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd6104-185f-436d-b05e-c11726e2503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:28.806969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd6104-185f-436d-b05e-c11726e2503f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.807266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd6104-185f-436d-b05e-c11726e2503f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.807545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd6104-185f-436d-b05e-c11726e2503f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.809759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bc8db-06ea-4c1e-b40b-7535f4b63c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:28.810577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bc8db-06ea-4c1e-b40b-7535f4b63c21 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.810861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bc8db-06ea-4c1e-b40b-7535f4b63c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.811138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bc8db-06ea-4c1e-b40b-7535f4b63c21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.817937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd6104-185f-436d-b05e-c11726e2503f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:28.818182 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bc8db-06ea-4c1e-b40b-7535f4b63c21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:28.819408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd6104-185f-436d-b05e-c11726e2503f None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:28.819624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bc8db-06ea-4c1e-b40b-7535f4b63c21 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8e0bc8db-06ea-4c1e-b40b-7535f4b63c21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:28.835773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:28.836740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:28.842607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:28.842607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:28.842607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:28.842607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:28.842607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:28.842607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:28.842607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:28.842607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:28.842607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 15:01:28.842607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:28.842607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 430/850] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 15:01:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-94cd6104-185f-436d-b05e-c11726e2503f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:28.843200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:28.844138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:28.845031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:28.845031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:28.845031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:28.845031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:28.845252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bc8db-06ea-4c1e-b40b-7535f4b63c21 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:28.845331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 421/851] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:28.845331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd6104-185f-436d-b05e-c11726e2503f None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:28.901791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:28.944213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bc8db-06ea-4c1e-b40b-7535f4b63c21 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:28.950348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd6104-185f-436d-b05e-c11726e2503f None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:28.983898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dc43c-ad6f-480a-95b1-5203871c31a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:28.984714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dc43c-ad6f-480a-95b1-5203871c31a7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.985001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dc43c-ad6f-480a-95b1-5203871c31a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.985275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dc43c-ad6f-480a-95b1-5203871c31a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.985589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:28.985935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dc43c-ad6f-480a-95b1-5203871c31a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:28.987329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dc43c-ad6f-480a-95b1-5203871c31a7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:28.991808 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca295a4f-ca0a-4910-a3f0-d3d307ee2cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:28.992610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca295a4f-ca0a-4910-a3f0-d3d307ee2cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:28.992988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca295a4f-ca0a-4910-a3f0-d3d307ee2cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:28.993360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca295a4f-ca0a-4910-a3f0-d3d307ee2cb5 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:28.994311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca295a4f-ca0a-4910-a3f0-d3d307ee2cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:28.994720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca295a4f-ca0a-4910-a3f0-d3d307ee2cb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:28.996279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca295a4f-ca0a-4910-a3f0-d3d307ee2cb5 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-777dc43c-ad6f-480a-95b1-5203871c31a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:28.999740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:29.000707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:01:29.001543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:29.006267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 431/852] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:01:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:29.006843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dc43c-ad6f-480a-95b1-5203871c31a7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:29.020856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 422/853] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 15:01:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:29.020856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca295a4f-ca0a-4910-a3f0-d3d307ee2cb5 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:29.111662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dc43c-ad6f-480a-95b1-5203871c31a7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:29.123341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca295a4f-ca0a-4910-a3f0-d3d307ee2cb5 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:29.135535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:29.150212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b3849-9d6b-4908-ba78-25138dcdb74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:29.151063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3849-9d6b-4908-ba78-25138dcdb74a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:29.151649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3849-9d6b-4908-ba78-25138dcdb74a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:29.151964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3849-9d6b-4908-ba78-25138dcdb74a None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:29.152976 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b3849-9d6b-4908-ba78-25138dcdb74a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:29.153287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b3849-9d6b-4908-ba78-25138dcdb74a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:29.155313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b3849-9d6b-4908-ba78-25138dcdb74a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:29.159414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2e621-08d4-47b5-a4d8-7b7e2e0c9376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:29.160246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2e621-08d4-47b5-a4d8-7b7e2e0c9376 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:29.160626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2e621-08d4-47b5-a4d8-7b7e2e0c9376 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:29.160999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2e621-08d4-47b5-a4d8-7b7e2e0c9376 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:29.162142 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2e621-08d4-47b5-a4d8-7b7e2e0c9376 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:29.162557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2e621-08d4-47b5-a4d8-7b7e2e0c9376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:29.164082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2e621-08d4-47b5-a4d8-7b7e2e0c9376 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:29.173303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 423/854] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:01:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:29.173303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2e621-08d4-47b5-a4d8-7b7e2e0c9376 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:29.173693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 432/855] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:29.174415 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b3849-9d6b-4908-ba78-25138dcdb74a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:29.231994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:29.281180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2e621-08d4-47b5-a4d8-7b7e2e0c9376 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:29.285358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b3849-9d6b-4908-ba78-25138dcdb74a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:29.319058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12553db-32ba-4b2c-8b59-867895500b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:29.319261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e89cf-d233-4193-971b-0d2a6e6b54a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:29.319746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e89cf-d233-4193-971b-0d2a6e6b54a8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:29.319922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12553db-32ba-4b2c-8b59-867895500b2f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:29.320021 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e89cf-d233-4193-971b-0d2a6e6b54a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:29.320200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12553db-32ba-4b2c-8b59-867895500b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:29.320293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e89cf-d233-4193-971b-0d2a6e6b54a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:29.320436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12553db-32ba-4b2c-8b59-867895500b2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:29.328317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12553db-32ba-4b2c-8b59-867895500b2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:29.330337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12553db-32ba-4b2c-8b59-867895500b2f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c12553db-32ba-4b2c-8b59-867895500b2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:29.344496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:29.345590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:29.346727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:29.346727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:29.346727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:29.346727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:29.346727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:29.346727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:29.346727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:29.346727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:29.347877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 433/856] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:29.349277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12553db-32ba-4b2c-8b59-867895500b2f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:29.398822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:29.399029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e89cf-d233-4193-971b-0d2a6e6b54a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:29.400578 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e89cf-d233-4193-971b-0d2a6e6b54a8 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:29.456355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:29.474860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12553db-32ba-4b2c-8b59-867895500b2f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:29.510966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 424/857] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:01:29.510966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e89cf-d233-4193-971b-0d2a6e6b54a8 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:29.518977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64969e-d4a5-4502-9d3a-68c8d82e3f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:29.519252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64969e-d4a5-4502-9d3a-68c8d82e3f1a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:29.519462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64969e-d4a5-4502-9d3a-68c8d82e3f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:29.519772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64969e-d4a5-4502-9d3a-68c8d82e3f1a None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:29.520502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64969e-d4a5-4502-9d3a-68c8d82e3f1a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:29.520816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64969e-d4a5-4502-9d3a-68c8d82e3f1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:29.522208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64969e-d4a5-4502-9d3a-68c8d82e3f1a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:29.535700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 434/858] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:01:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:29.535700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64969e-d4a5-4502-9d3a-68c8d82e3f1a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:29.644591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64969e-d4a5-4502-9d3a-68c8d82e3f1a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:29.653344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:29.655686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e89cf-d233-4193-971b-0d2a6e6b54a8 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:29.684083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec0b22-2803-438c-ba83-158cd88f0480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:29.685066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec0b22-2803-438c-ba83-158cd88f0480 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:29.685446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec0b22-2803-438c-ba83-158cd88f0480 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:29.686288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec0b22-2803-438c-ba83-158cd88f0480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:29.699507 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec0b22-2803-438c-ba83-158cd88f0480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:29.701025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec0b22-2803-438c-ba83-158cd88f0480 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:29.704603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e344e1-609f-4315-9652-9d4a87436db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:29.705284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e344e1-609f-4315-9652-9d4a87436db8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:29.705568 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e344e1-609f-4315-9652-9d4a87436db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:29.705839 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e344e1-609f-4315-9652-9d4a87436db8 None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:29.706650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e344e1-609f-4315-9652-9d4a87436db8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:29.706965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e344e1-609f-4315-9652-9d4a87436db8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:29.708473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e344e1-609f-4315-9652-9d4a87436db8 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-67ec0b22-2803-438c-ba83-158cd88f0480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:29.720019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:29.721083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:29.722276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:29.722276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:29.722276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:29.722276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:29.724287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 435/859] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:29.725816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234bb3-7932-4e2d-96ef-8c7b56b89abd None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:29.726341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234bb3-7932-4e2d-96ef-8c7b56b89abd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:29.726548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 425/860] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:29.726920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234bb3-7932-4e2d-96ef-8c7b56b89abd None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:29.729477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e344e1-609f-4315-9652-9d4a87436db8 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:29.731699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 436/861] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:29.732979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3234bb3-7932-4e2d-96ef-8c7b56b89abd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:29.751469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:29.846312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e344e1-609f-4315-9652-9d4a87436db8 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:29.848284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3234bb3-7932-4e2d-96ef-8c7b56b89abd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:29.882580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bac422-cb3a-43b5-a62b-4f51573c0285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:29.882787 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fef2c8-ddb8-4a35-95ca-3ba7fab0ee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:29.883256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac422-cb3a-43b5-a62b-4f51573c0285 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:29.883398 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fef2c8-ddb8-4a35-95ca-3ba7fab0ee21 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:29.883594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac422-cb3a-43b5-a62b-4f51573c0285 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:29.883696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fef2c8-ddb8-4a35-95ca-3ba7fab0ee21 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:29.883919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac422-cb3a-43b5-a62b-4f51573c0285 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:29.884019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fef2c8-ddb8-4a35-95ca-3ba7fab0ee21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:29.884651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bac422-cb3a-43b5-a62b-4f51573c0285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:29.884811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fef2c8-ddb8-4a35-95ca-3ba7fab0ee21 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=1643cf33cd3b417bb2cd15b5503f7ffd) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:29.884972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bac422-cb3a-43b5-a62b-4f51573c0285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:29.885119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fef2c8-ddb8-4a35-95ca-3ba7fab0ee21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:29.886340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bac422-cb3a-43b5-a62b-4f51573c0285 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:29.886518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fef2c8-ddb8-4a35-95ca-3ba7fab0ee21 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:29.893054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 437/862] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:29 2022] GET /identity/v3/role_assignments?user.id=1643cf33cd3b417bb2cd15b5503f7ffd&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:29.903532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 426/863] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:29.903771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1bac3-0580-4a04-947f-181298f9152b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:29.903771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1bac3-0580-4a04-947f-181298f9152b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:29.903771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1bac3-0580-4a04-947f-181298f9152b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:29.905562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bac422-cb3a-43b5-a62b-4f51573c0285 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:29.923797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-94e1bac3-0580-4a04-947f-181298f9152b None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:29.925092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-94e1bac3-0580-4a04-947f-181298f9152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:29.945277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:30.004293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 438/864] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:30.016850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:30.027075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1bac3-0580-4a04-947f-181298f9152b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:30.054038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bac422-cb3a-43b5-a62b-4f51573c0285 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:30.094505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db174bd-dfd6-4675-aae7-2b7bc42f0435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:30.095905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db174bd-dfd6-4675-aae7-2b7bc42f0435 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:30.096476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db174bd-dfd6-4675-aae7-2b7bc42f0435 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:30.096903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db174bd-dfd6-4675-aae7-2b7bc42f0435 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:30.105478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db174bd-dfd6-4675-aae7-2b7bc42f0435 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:30.107277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db174bd-dfd6-4675-aae7-2b7bc42f0435 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-1db174bd-dfd6-4675-aae7-2b7bc42f0435 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:30.123397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:30.124495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:30.125454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:30.125454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:30.125454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:30.125454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:30.125454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:30.125454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:30.125454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:30.125454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:30.131670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 427/865] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:30.133606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db174bd-dfd6-4675-aae7-2b7bc42f0435 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:30.143934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1bac3-0580-4a04-947f-181298f9152b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:30.185755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb958ec-3999-4021-aede-ba3c335af3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:30.186609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb958ec-3999-4021-aede-ba3c335af3df None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:30.186935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb958ec-3999-4021-aede-ba3c335af3df None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:30.187215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb958ec-3999-4021-aede-ba3c335af3df None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:30.188024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb958ec-3999-4021-aede-ba3c335af3df None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:30.189509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb958ec-3999-4021-aede-ba3c335af3df None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-acb958ec-3999-4021-aede-ba3c335af3df None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:30.202826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:30.204040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:01:30.205084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:30.209109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 439/866] 10.222.0.24 () {56 vars in 1132 bytes} [Wed May 25 15:01:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:30.210148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb958ec-3999-4021-aede-ba3c335af3df None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:30.235041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:30.273561 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db174bd-dfd6-4675-aae7-2b7bc42f0435 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:30.310460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b595a5-10e4-4f39-b0aa-f1ca63d5b408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:30.311297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b595a5-10e4-4f39-b0aa-f1ca63d5b408 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:30.311608 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b595a5-10e4-4f39-b0aa-f1ca63d5b408 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:30.311950 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b595a5-10e4-4f39-b0aa-f1ca63d5b408 None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:30.312951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b595a5-10e4-4f39-b0aa-f1ca63d5b408 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:30.313283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b595a5-10e4-4f39-b0aa-f1ca63d5b408 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:30.314930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b595a5-10e4-4f39-b0aa-f1ca63d5b408 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:30.317183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:30.335294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 428/867] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:30.337756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b595a5-10e4-4f39-b0aa-f1ca63d5b408 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:30.348969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb958ec-3999-4021-aede-ba3c335af3df None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:30.391029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c8d22-d288-40ba-bb93-1da2fab37188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:30.392013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c8d22-d288-40ba-bb93-1da2fab37188 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:30.392687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c8d22-d288-40ba-bb93-1da2fab37188 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:30.393116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c8d22-d288-40ba-bb93-1da2fab37188 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:30.394480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c8d22-d288-40ba-bb93-1da2fab37188 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:30.395202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c8d22-d288-40ba-bb93-1da2fab37188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:30.397041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c8d22-d288-40ba-bb93-1da2fab37188 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:30.403811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 440/868] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 15:01:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:30.409739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c8d22-d288-40ba-bb93-1da2fab37188 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:30.477065 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b595a5-10e4-4f39-b0aa-f1ca63d5b408 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:30.520375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:30.527787 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994cdd1-2707-4739-bf0e-59ec66cb26b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:30.528817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994cdd1-2707-4739-bf0e-59ec66cb26b6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:30.529108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994cdd1-2707-4739-bf0e-59ec66cb26b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:30.529394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994cdd1-2707-4739-bf0e-59ec66cb26b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:30.530791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994cdd1-2707-4739-bf0e-59ec66cb26b6 None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=042393fa408b45208021befccd6bd800) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:30.531141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994cdd1-2707-4739-bf0e-59ec66cb26b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:30.532677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994cdd1-2707-4739-bf0e-59ec66cb26b6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:30.543713 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 429/869] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:30 2022] GET /identity/v3/role_assignments?user.id=042393fa408b45208021befccd6bd800&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:30.555498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c8d22-d288-40ba-bb93-1da2fab37188 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:30.593666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314858a-3bda-4590-857f-83f3004b3a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:30.594793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314858a-3bda-4590-857f-83f3004b3a77 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:30.595331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314858a-3bda-4590-857f-83f3004b3a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:30.595863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314858a-3bda-4590-857f-83f3004b3a77 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:30.596802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314858a-3bda-4590-857f-83f3004b3a77 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:30.597319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314858a-3bda-4590-857f-83f3004b3a77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:30.598913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314858a-3bda-4590-857f-83f3004b3a77 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:30.605055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 441/870] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 15:01:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:31.802800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0a7b7-3bd6-447d-bbb1-4c9bf9bc95c5 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:31.803326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0a7b7-3bd6-447d-bbb1-4c9bf9bc95c5 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:31.803326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0a7b7-3bd6-447d-bbb1-4c9bf9bc95c5 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:31.804984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 430/871] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:31.810569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28ef52-7c22-4dbd-9b20-74efb6fd33a6 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:31.811030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28ef52-7c22-4dbd-9b20-74efb6fd33a6 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:31.811111 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28ef52-7c22-4dbd-9b20-74efb6fd33a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:31.828607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ff28ef52-7c22-4dbd-9b20-74efb6fd33a6 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:31.829788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ff28ef52-7c22-4dbd-9b20-74efb6fd33a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:31.903979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 442/872] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:31.925880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0a7b7-3bd6-447d-bbb1-4c9bf9bc95c5 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:31.989370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:32.036025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0a7b7-3bd6-447d-bbb1-4c9bf9bc95c5 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:32.071866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1776a-1118-47ea-b497-46b7a4c162d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:32.072460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1776a-1118-47ea-b497-46b7a4c162d1 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:32.072752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1776a-1118-47ea-b497-46b7a4c162d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:32.073039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1776a-1118-47ea-b497-46b7a4c162d1 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:32.073968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1776a-1118-47ea-b497-46b7a4c162d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:32.075364 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1776a-1118-47ea-b497-46b7a4c162d1 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:32.091048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 431/873] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 15:01:31 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:32.210844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6d4b-469a-4e42-8cf5-c2e2ef6ef864 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:32.211549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6d4b-469a-4e42-8cf5-c2e2ef6ef864 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:32.212084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6d4b-469a-4e42-8cf5-c2e2ef6ef864 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:32.214028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 443/874] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:32.220487 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceec468-93f5-4e86-babb-2e3b1ed8c574 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:32.221116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceec468-93f5-4e86-babb-2e3b1ed8c574 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:32.221636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceec468-93f5-4e86-babb-2e3b1ed8c574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:32.241620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-cceec468-93f5-4e86-babb-2e3b1ed8c574 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:32.243210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-cceec468-93f5-4e86-babb-2e3b1ed8c574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:32.329653 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 432/875] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:32.350992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb6d4b-469a-4e42-8cf5-c2e2ef6ef864 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:32.431051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:32.470836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb6d4b-469a-4e42-8cf5-c2e2ef6ef864 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:32.507260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c7132-66a7-459a-b83c-cadae0d039bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:32.508112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c7132-66a7-459a-b83c-cadae0d039bf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:32.508400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c7132-66a7-459a-b83c-cadae0d039bf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:32.508680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c7132-66a7-459a-b83c-cadae0d039bf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:32.509355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c7132-66a7-459a-b83c-cadae0d039bf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:32.510734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c7132-66a7-459a-b83c-cadae0d039bf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a40c7132-66a7-459a-b83c-cadae0d039bf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:32.523064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:32.524120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:32.524949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:32.529383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 444/876] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 15:01:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:32.530777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceec468-93f5-4e86-babb-2e3b1ed8c574 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:32.578981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:32.639659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceec468-93f5-4e86-babb-2e3b1ed8c574 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:32.677231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bf982-2f08-4d02-af4c-270bc2a2ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:32.678084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf982-2f08-4d02-af4c-270bc2a2ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:32.678376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf982-2f08-4d02-af4c-270bc2a2ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:32.678659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf982-2f08-4d02-af4c-270bc2a2ebf6 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:32.679383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bf982-2f08-4d02-af4c-270bc2a2ebf6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:32.679724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bf982-2f08-4d02-af4c-270bc2a2ebf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:32.681113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bf982-2f08-4d02-af4c-270bc2a2ebf6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:32.690242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 433/877] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 15:01:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:32.692167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c7132-66a7-459a-b83c-cadae0d039bf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:32.804434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c7132-66a7-459a-b83c-cadae0d039bf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:32.820598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acd42a-7b7e-4abd-af7d-42ef62a07c83 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:32.821104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acd42a-7b7e-4abd-af7d-42ef62a07c83 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:32.821179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acd42a-7b7e-4abd-af7d-42ef62a07c83 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:32.822765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 434/878] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:32.832769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbecc4-3003-4ecd-afba-9297c8f3fd11 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:32.833155 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbecc4-3003-4ecd-afba-9297c8f3fd11 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:32.833415 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbecc4-3003-4ecd-afba-9297c8f3fd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:32.843332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6c4bb-b53a-4fe7-aa3f-05db8fc12aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:32.844143 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6c4bb-b53a-4fe7-aa3f-05db8fc12aae None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:32.844492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6c4bb-b53a-4fe7-aa3f-05db8fc12aae None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:32.844862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6c4bb-b53a-4fe7-aa3f-05db8fc12aae None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:32.845644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6c4bb-b53a-4fe7-aa3f-05db8fc12aae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:32.845961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6c4bb-b53a-4fe7-aa3f-05db8fc12aae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:32.847345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6c4bb-b53a-4fe7-aa3f-05db8fc12aae None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:32.851284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-b3fbecc4-3003-4ecd-afba-9297c8f3fd11 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:32.852736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-b3fbecc4-3003-4ecd-afba-9297c8f3fd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:32.859690 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 445/879] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 15:01:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:32.914227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448ba1c-e3ca-4c1c-a112-c7139f87739d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:32.914420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448ba1c-e3ca-4c1c-a112-c7139f87739d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:32.914709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448ba1c-e3ca-4c1c-a112-c7139f87739d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:32.916337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 446/880] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:32.922374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bf639-7dcb-4359-848a-959b69bcf4a4 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:32.922747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bf639-7dcb-4359-848a-959b69bcf4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:32.922945 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bf639-7dcb-4359-848a-959b69bcf4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:32.928206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:32.943211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d06bf639-7dcb-4359-848a-959b69bcf4a4 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:32.945007 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d06bf639-7dcb-4359-848a-959b69bcf4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:32.947715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 435/881] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:32.966541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbecc4-3003-4ecd-afba-9297c8f3fd11 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:33.020376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:33.031717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 447/882] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:33.050368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bf639-7dcb-4359-848a-959b69bcf4a4 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:33.086305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbecc4-3003-4ecd-afba-9297c8f3fd11 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:33.120648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aef520-ce1e-4653-a68c-8dc74d0b4da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:33.121340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aef520-ce1e-4653-a68c-8dc74d0b4da4 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:33.121621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aef520-ce1e-4653-a68c-8dc74d0b4da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:33.121894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aef520-ce1e-4653-a68c-8dc74d0b4da4 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:33.122620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aef520-ce1e-4653-a68c-8dc74d0b4da4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:33.124038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aef520-ce1e-4653-a68c-8dc74d0b4da4 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:33.142525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 436/883] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 15:01:32 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:01:33.180047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bf639-7dcb-4359-848a-959b69bcf4a4 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:33.215304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:33.227899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8a893-5627-4ae5-a090-e6c917b00a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:33.229164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8a893-5627-4ae5-a090-e6c917b00a91 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:33.230021 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8a893-5627-4ae5-a090-e6c917b00a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:33.230297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8a893-5627-4ae5-a090-e6c917b00a91 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:33.243090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8a893-5627-4ae5-a090-e6c917b00a91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9dd8a893-5627-4ae5-a090-e6c917b00a91 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:33.251974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:33.253052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:33.254282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 448/884] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 15:01:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:33.261576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aef520-ce1e-4653-a68c-8dc74d0b4da4 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:33.375514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:33.380337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aef520-ce1e-4653-a68c-8dc74d0b4da4 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:33.416001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5daf18-e21a-4131-8556-1d2f2ceffad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:33.416686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5daf18-e21a-4131-8556-1d2f2ceffad8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:33.416973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5daf18-e21a-4131-8556-1d2f2ceffad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:33.417250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5daf18-e21a-4131-8556-1d2f2ceffad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:33.418017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5daf18-e21a-4131-8556-1d2f2ceffad8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:33.418326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5daf18-e21a-4131-8556-1d2f2ceffad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:33.419735 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5daf18-e21a-4131-8556-1d2f2ceffad8 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:33.429151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 437/885] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 15:01:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:33.437351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8a893-5627-4ae5-a090-e6c917b00a91 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:33.539816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8a893-5627-4ae5-a090-e6c917b00a91 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:33.573592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13842c71-a60f-47c5-98f3-e6db2a5b73f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:33.574397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13842c71-a60f-47c5-98f3-e6db2a5b73f2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:33.574681 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13842c71-a60f-47c5-98f3-e6db2a5b73f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:33.574954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13842c71-a60f-47c5-98f3-e6db2a5b73f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:33.585893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13842c71-a60f-47c5-98f3-e6db2a5b73f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:33.587355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13842c71-a60f-47c5-98f3-e6db2a5b73f2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-13842c71-a60f-47c5-98f3-e6db2a5b73f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:33.604408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:33.605331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:33.606486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:33.606486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:33.606486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:33.606486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:33.606486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 449/886] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:33.612942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5daf18-e21a-4131-8556-1d2f2ceffad8 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:33.724540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5daf18-e21a-4131-8556-1d2f2ceffad8 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:33.759433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151486-388b-4eee-9874-ff0099bd96c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:33.760128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151486-388b-4eee-9874-ff0099bd96c5 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:33.760418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151486-388b-4eee-9874-ff0099bd96c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:33.760701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151486-388b-4eee-9874-ff0099bd96c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:33.761440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99151486-388b-4eee-9874-ff0099bd96c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:33.761751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99151486-388b-4eee-9874-ff0099bd96c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:33.763141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99151486-388b-4eee-9874-ff0099bd96c5 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:33.775972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 438/887] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:33.781712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13842c71-a60f-47c5-98f3-e6db2a5b73f2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:33.828367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:33.893491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13842c71-a60f-47c5-98f3-e6db2a5b73f2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:33.927508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9244f-7fa6-4a66-ad78-82f7c79f2a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:33.928474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9244f-7fa6-4a66-ad78-82f7c79f2a54 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:33.928758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9244f-7fa6-4a66-ad78-82f7c79f2a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:33.929033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9244f-7fa6-4a66-ad78-82f7c79f2a54 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:33.937586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9244f-7fa6-4a66-ad78-82f7c79f2a54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:33.939087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9244f-7fa6-4a66-ad78-82f7c79f2a54 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-89d9244f-7fa6-4a66-ad78-82f7c79f2a54 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:33.954084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:33.955082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:33.956230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:33.956230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:33.956230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:33.956230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:33.956230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:33.956230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:33.956230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:33.956230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:33.956230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 15:01:33.956230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:33.956230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 450/888] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 15:01:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:33.963232 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151486-388b-4eee-9874-ff0099bd96c5 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:33.986828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:34.085071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151486-388b-4eee-9874-ff0099bd96c5 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:34.121264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7814d-9904-4778-bdf6-32cf436f60d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:34.121935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7814d-9904-4778-bdf6-32cf436f60d0 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.122215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7814d-9904-4778-bdf6-32cf436f60d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.122491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7814d-9904-4778-bdf6-32cf436f60d0 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.123339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7814d-9904-4778-bdf6-32cf436f60d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:34.123676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7814d-9904-4778-bdf6-32cf436f60d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:34.125121 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7814d-9904-4778-bdf6-32cf436f60d0 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:34.143485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 439/889] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 15:01:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:34.152497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9244f-7fa6-4a66-ad78-82f7c79f2a54 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:34.254028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:34.258691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9244f-7fa6-4a66-ad78-82f7c79f2a54 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:34.300739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3774b-1406-41e5-822b-6809fd3247d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:34.301791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3774b-1406-41e5-822b-6809fd3247d2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.302314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3774b-1406-41e5-822b-6809fd3247d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.302796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3774b-1406-41e5-822b-6809fd3247d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.374881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3774b-1406-41e5-822b-6809fd3247d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:34.376804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3774b-1406-41e5-822b-6809fd3247d2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:34.437198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc00ad1-1687-4599-9800-86ecaaec667f None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.437198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc00ad1-1687-4599-9800-86ecaaec667f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.437198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc00ad1-1687-4599-9800-86ecaaec667f None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.437812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 440/890] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:34.443990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cec35-3e5b-48cb-ac75-2b438e3544e0 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.446139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cec35-3e5b-48cb-ac75-2b438e3544e0 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.446139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cec35-3e5b-48cb-ac75-2b438e3544e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.463534 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-468cec35-3e5b-48cb-ac75-2b438e3544e0 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:34.464764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-468cec35-3e5b-48cb-ac75-2b438e3544e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:34.491585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:34.498070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 451/891] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:34 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:01:34.504728 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3774b-1406-41e5-822b-6809fd3247d2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:34.541631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 441/892] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:34.561779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cec35-3e5b-48cb-ac75-2b438e3544e0 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:34.573182 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:34.632543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3774b-1406-41e5-822b-6809fd3247d2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:34.670191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cec35-3e5b-48cb-ac75-2b438e3544e0 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:34.681051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d94f2-1e33-4d0f-98e1-62c0e34d9905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:34.682612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d94f2-1e33-4d0f-98e1-62c0e34d9905 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.683408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d94f2-1e33-4d0f-98e1-62c0e34d9905 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.683933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d94f2-1e33-4d0f-98e1-62c0e34d9905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.697972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d94f2-1e33-4d0f-98e1-62c0e34d9905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:34.700635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d94f2-1e33-4d0f-98e1-62c0e34d9905 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:34.712563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0c277-4dff-47f4-86fd-63ca28b0065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:34.715040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0c277-4dff-47f4-86fd-63ca28b0065e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.715538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0c277-4dff-47f4-86fd-63ca28b0065e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.716050 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0c277-4dff-47f4-86fd-63ca28b0065e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.716941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0c277-4dff-47f4-86fd-63ca28b0065e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:34.718548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0c277-4dff-47f4-86fd-63ca28b0065e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b84d94f2-1e33-4d0f-98e1-62c0e34d9905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:34.720177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:34.721054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:34.721958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:34.721958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:34.721958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:34.721958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:34.726095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 452/893] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:34.727114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d94f2-1e33-4d0f-98e1-62c0e34d9905 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-27c0c277-4dff-47f4-86fd-63ca28b0065e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:34.735277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:34.736381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:01:34.737254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:34.743643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 442/894] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:01:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:34.746737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0c277-4dff-47f4-86fd-63ca28b0065e None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:34.781586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:34.828800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:34.830772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d94f2-1e33-4d0f-98e1-62c0e34d9905 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:34.863029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0c277-4dff-47f4-86fd-63ca28b0065e None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:34.873118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd544f6-c2ac-48c7-b509-ce99c8c79f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:34.873118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd544f6-c2ac-48c7-b509-ce99c8c79f57 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.873118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd544f6-c2ac-48c7-b509-ce99c8c79f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.873118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd544f6-c2ac-48c7-b509-ce99c8c79f57 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.873482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd544f6-c2ac-48c7-b509-ce99c8c79f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:34.873482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd544f6-c2ac-48c7-b509-ce99c8c79f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:34.873482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd544f6-c2ac-48c7-b509-ce99c8c79f57 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:34.884854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 453/895] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:34.890365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd544f6-c2ac-48c7-b509-ce99c8c79f57 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:34.899286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232bd9a-2846-4026-8d65-fde35453f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:34.900000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232bd9a-2846-4026-8d65-fde35453f013 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:34.900287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232bd9a-2846-4026-8d65-fde35453f013 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:34.900567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232bd9a-2846-4026-8d65-fde35453f013 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:34.901295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232bd9a-2846-4026-8d65-fde35453f013 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:34.901605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232bd9a-2846-4026-8d65-fde35453f013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:34.903438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232bd9a-2846-4026-8d65-fde35453f013 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:34.910156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 443/896] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:01:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:34.915468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232bd9a-2846-4026-8d65-fde35453f013 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:35.007764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd544f6-c2ac-48c7-b509-ce99c8c79f57 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.018052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232bd9a-2846-4026-8d65-fde35453f013 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.023430 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:35.047816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a234e-bb1f-413a-bc00-6fc826fba9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.049052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a234e-bb1f-413a-bc00-6fc826fba9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.049629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a234e-bb1f-413a-bc00-6fc826fba9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.050113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a234e-bb1f-413a-bc00-6fc826fba9a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.054404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cd552-c590-47b9-8c73-a904794e6015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.055081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cd552-c590-47b9-8c73-a904794e6015 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.055368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cd552-c590-47b9-8c73-a904794e6015 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.055679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cd552-c590-47b9-8c73-a904794e6015 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.056407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cd552-c590-47b9-8c73-a904794e6015 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:35.056722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cd552-c590-47b9-8c73-a904794e6015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.058106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cd552-c590-47b9-8c73-a904794e6015 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.059579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a234e-bb1f-413a-bc00-6fc826fba9a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.060274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:35.062949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a234e-bb1f-413a-bc00-6fc826fba9a2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.070010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 444/897] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:01:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:35.070976 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cd552-c590-47b9-8c73-a904794e6015 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-bd1a234e-bb1f-413a-bc00-6fc826fba9a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:35.080304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:35.081248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:35.082186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:35.082186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:35.082186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:35.082186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:35.082186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:35.082186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:35.082186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:35.082186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:35.089532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 454/898] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:35.091201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a234e-bb1f-413a-bc00-6fc826fba9a2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:35.177632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cd552-c590-47b9-8c73-a904794e6015 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.203526 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a234e-bb1f-413a-bc00-6fc826fba9a2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.212465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5907ae-088b-422d-a19c-8c586219025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.212830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5907ae-088b-422d-a19c-8c586219025e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.213125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5907ae-088b-422d-a19c-8c586219025e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.213406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5907ae-088b-422d-a19c-8c586219025e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.214218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5907ae-088b-422d-a19c-8c586219025e None admin] RBAC: Adding query filter params (interface=public, service_id=90389602adc34bec862f223d79a20759, region_id=RegionOne) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:35.214536 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5907ae-088b-422d-a19c-8c586219025e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.215963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5907ae-088b-422d-a19c-8c586219025e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.226193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 445/899] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 15:01:35 2022] GET /identity/v3/endpoints?service_id=90389602adc34bec862f223d79a20759&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:35.227055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5907ae-088b-422d-a19c-8c586219025e None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:35.243254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d149565-d085-4b60-9b16-d12c225b0a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.244372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d149565-d085-4b60-9b16-d12c225b0a81 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.244856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d149565-d085-4b60-9b16-d12c225b0a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.245345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d149565-d085-4b60-9b16-d12c225b0a81 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.246470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d149565-d085-4b60-9b16-d12c225b0a81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:35.247080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d149565-d085-4b60-9b16-d12c225b0a81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.248746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d149565-d085-4b60-9b16-d12c225b0a81 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.267914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 455/900] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:35.271229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d149565-d085-4b60-9b16-d12c225b0a81 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:35.294699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:35.308615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:35.333708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5907ae-088b-422d-a19c-8c586219025e None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.372380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c50117-f0b8-4c75-ae46-f9fda67b413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.373052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c50117-f0b8-4c75-ae46-f9fda67b413e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.373434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c50117-f0b8-4c75-ae46-f9fda67b413e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.373733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c50117-f0b8-4c75-ae46-f9fda67b413e None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.374518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c50117-f0b8-4c75-ae46-f9fda67b413e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.376065 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c50117-f0b8-4c75-ae46-f9fda67b413e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.380241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d149565-d085-4b60-9b16-d12c225b0a81 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.386805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 446/901] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 15:01:35 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:35.386805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d29d12-c2f4-48b3-9a3f-d28fb26e6810 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.386805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d29d12-c2f4-48b3-9a3f-d28fb26e6810 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.386805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d29d12-c2f4-48b3-9a3f-d28fb26e6810 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.386805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 447/902] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:35.391379 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b2b99-9699-4e99-bb8f-3d228f60b361 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.393311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b2b99-9699-4e99-bb8f-3d228f60b361 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.393311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b2b99-9699-4e99-bb8f-3d228f60b361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.413011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-230b2b99-9699-4e99-bb8f-3d228f60b361 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:35.414526 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-230b2b99-9699-4e99-bb8f-3d228f60b361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:35.424456 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab54c02-d8fa-4031-bd46-5ff60b11fdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.425327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab54c02-d8fa-4031-bd46-5ff60b11fdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.425759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab54c02-d8fa-4031-bd46-5ff60b11fdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.426103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab54c02-d8fa-4031-bd46-5ff60b11fdd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.427095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab54c02-d8fa-4031-bd46-5ff60b11fdd3 None admin] RBAC: Adding query filter params (role.id=b25816a24b4b4ca48ca941a6d06fe5b3, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=042393fa408b45208021befccd6bd800) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:35.427541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab54c02-d8fa-4031-bd46-5ff60b11fdd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.429149 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab54c02-d8fa-4031-bd46-5ff60b11fdd3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.436048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 456/903] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:35 2022] GET /identity/v3/role_assignments?user.id=042393fa408b45208021befccd6bd800&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=b25816a24b4b4ca48ca941a6d06fe5b3 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:35.466330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ef8a-398d-4b6e-a237-b0fb12a8fa8c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.466647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ef8a-398d-4b6e-a237-b0fb12a8fa8c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.466907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ef8a-398d-4b6e-a237-b0fb12a8fa8c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.473318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 457/904] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:35.474855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82ce11-ea1d-4b90-a0b4-cf0023701a59 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.475153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82ce11-ea1d-4b90-a0b4-cf0023701a59 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.475443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82ce11-ea1d-4b90-a0b4-cf0023701a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.493884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ea82ce11-ea1d-4b90-a0b4-cf0023701a59 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:35.495175 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ea82ce11-ea1d-4b90-a0b4-cf0023701a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:35.519710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 448/905] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:35.537954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b2b99-9699-4e99-bb8f-3d228f60b361 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:35.581276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 458/906] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:35.606202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82ce11-ea1d-4b90-a0b4-cf0023701a59 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:35.621572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:35.649132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:35.675830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b2b99-9699-4e99-bb8f-3d228f60b361 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.721326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ede3-d345-4335-8eb8-6164dfe458c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.722847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ede3-d345-4335-8eb8-6164dfe458c4 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.723581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ede3-d345-4335-8eb8-6164dfe458c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.724459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ede3-d345-4335-8eb8-6164dfe458c4 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.725877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944ede3-d345-4335-8eb8-6164dfe458c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.728460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944ede3-d345-4335-8eb8-6164dfe458c4 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.744060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82ce11-ea1d-4b90-a0b4-cf0023701a59 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.747659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 449/907] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 15:01:35 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:01:35.798748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39397662-8ac2-40a4-b5cf-1d12635e3d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.799672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39397662-8ac2-40a4-b5cf-1d12635e3d03 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.799963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39397662-8ac2-40a4-b5cf-1d12635e3d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.800290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39397662-8ac2-40a4-b5cf-1d12635e3d03 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.801071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39397662-8ac2-40a4-b5cf-1d12635e3d03 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.802454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39397662-8ac2-40a4-b5cf-1d12635e3d03 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-39397662-8ac2-40a4-b5cf-1d12635e3d03 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:35.816961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:35.818282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:35.819694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 459/908] 10.222.0.24 () {56 vars in 1132 bytes} [Wed May 25 15:01:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:35.827078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ede3-d345-4335-8eb8-6164dfe458c4 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:35.947037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ede3-d345-4335-8eb8-6164dfe458c4 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:35.965105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:35.984203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1524f8a-2ad6-492d-a706-f690202fb9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:35.984896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1524f8a-2ad6-492d-a706-f690202fb9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:35.985186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1524f8a-2ad6-492d-a706-f690202fb9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:35.985602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1524f8a-2ad6-492d-a706-f690202fb9d3 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:35.986341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1524f8a-2ad6-492d-a706-f690202fb9d3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:35.986653 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1524f8a-2ad6-492d-a706-f690202fb9d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:35.989915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1524f8a-2ad6-492d-a706-f690202fb9d3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:35.995054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 450/909] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 15:01:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:36.000620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39397662-8ac2-40a4-b5cf-1d12635e3d03 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:36.091219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:36.107480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39397662-8ac2-40a4-b5cf-1d12635e3d03 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:36.142347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f8f58-0adf-481c-9293-413792fb5ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:36.143027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f8f58-0adf-481c-9293-413792fb5ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:36.143316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f8f58-0adf-481c-9293-413792fb5ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:36.143629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f8f58-0adf-481c-9293-413792fb5ab4 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:36.144415 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f8f58-0adf-481c-9293-413792fb5ab4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:36.144733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f8f58-0adf-481c-9293-413792fb5ab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:36.146169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f8f58-0adf-481c-9293-413792fb5ab4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:36.155669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 460/910] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 15:01:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:36.157609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1524f8a-2ad6-492d-a706-f690202fb9d3 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:36.263074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1524f8a-2ad6-492d-a706-f690202fb9d3 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:36.298494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90da42-bc7d-435a-a59a-08720240dd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:36.299160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90da42-bc7d-435a-a59a-08720240dd20 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:36.299444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90da42-bc7d-435a-a59a-08720240dd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:36.299746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90da42-bc7d-435a-a59a-08720240dd20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:36.300552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90da42-bc7d-435a-a59a-08720240dd20 None admin] RBAC: Adding query filter params (interface=public, service_id=44e1287852c94f8c994d1aa9b235b96a, region_id=RegionOne) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:36.300864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90da42-bc7d-435a-a59a-08720240dd20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:36.302240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90da42-bc7d-435a-a59a-08720240dd20 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:36.307861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 451/911] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 15:01:36 2022] GET /identity/v3/endpoints?service_id=44e1287852c94f8c994d1aa9b235b96a&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:36.313694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f8f58-0adf-481c-9293-413792fb5ab4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:36.418463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f8f58-0adf-481c-9293-413792fb5ab4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:36.452961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902cc7b-ca9f-4006-961d-6ae211c37d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:36.455603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902cc7b-ca9f-4006-961d-6ae211c37d78 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:36.455603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902cc7b-ca9f-4006-961d-6ae211c37d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:36.455603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902cc7b-ca9f-4006-961d-6ae211c37d78 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:36.455603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902cc7b-ca9f-4006-961d-6ae211c37d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:36.456299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902cc7b-ca9f-4006-961d-6ae211c37d78 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:36.466828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 461/912] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 15:01:36 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:37.692445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878382d-9da9-4a2d-89b2-0b0b699c76e3 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:37.693470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878382d-9da9-4a2d-89b2-0b0b699c76e3 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:37.693961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878382d-9da9-4a2d-89b2-0b0b699c76e3 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:37.695795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 452/913] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:37.701554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cd464-08a0-4b84-a681-5a48e81f2727 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:37.702355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cd464-08a0-4b84-a681-5a48e81f2727 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:37.702852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cd464-08a0-4b84-a681-5a48e81f2727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:37.716220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d157a-e44a-485e-b44c-0b4beb77e5c9 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:37.716528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d157a-e44a-485e-b44c-0b4beb77e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:37.716791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d157a-e44a-485e-b44c-0b4beb77e5c9 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:37.718428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 453/914] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:37.721931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0f5cd464-08a0-4b84-a681-5a48e81f2727 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:37.723403 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0f5cd464-08a0-4b84-a681-5a48e81f2727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:37.723643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b0469-8f07-4194-a4da-f50dda3cb232 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:37.723899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b0469-8f07-4194-a4da-f50dda3cb232 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:37.724183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b0469-8f07-4194-a4da-f50dda3cb232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:37.734990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:37.742661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-4e1b0469-8f07-4194-a4da-f50dda3cb232 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:37.744086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-4e1b0469-8f07-4194-a4da-f50dda3cb232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:37.808579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 462/915] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:37.816071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:37.827105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 454/916] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:37.837371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cd464-08a0-4b84-a681-5a48e81f2727 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:37.858117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b0469-8f07-4194-a4da-f50dda3cb232 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:37.949330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cd464-08a0-4b84-a681-5a48e81f2727 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:37.958531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b0469-8f07-4194-a4da-f50dda3cb232 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:37.986471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d6370-9345-43ac-aa72-b9ba0a1fc838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:37.987685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d6370-9345-43ac-aa72-b9ba0a1fc838 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:37.988260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d6370-9345-43ac-aa72-b9ba0a1fc838 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:37.988783 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d6370-9345-43ac-aa72-b9ba0a1fc838 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:37.993904 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6862d2-77df-4cef-a174-ea8278aae164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:37.994715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6862d2-77df-4cef-a174-ea8278aae164 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:37.995001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6862d2-77df-4cef-a174-ea8278aae164 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:37.995277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6862d2-77df-4cef-a174-ea8278aae164 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:37.995990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6862d2-77df-4cef-a174-ea8278aae164 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:37.997477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6862d2-77df-4cef-a174-ea8278aae164 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:38.001219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d6370-9345-43ac-aa72-b9ba0a1fc838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4d7d6370-9345-43ac-aa72-b9ba0a1fc838 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:38.010236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:38.011206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:38.012093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:38.012093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:38.012093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:38.012093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:38.012093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:38.012093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:38.012093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:38.012093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:38.012093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:38.012093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:38.012093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 15:01:38.012093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-7f6862d2-77df-4cef-a174-ea8278aae164 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:38.012736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:38.013636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:01:38.014462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:38.015652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 455/917] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:01:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:38.017161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e254ea-845e-4989-ab41-14a7e440f560 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.017474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e254ea-845e-4989-ab41-14a7e440f560 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.017747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e254ea-845e-4989-ab41-14a7e440f560 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.019207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 456/919] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:38.019625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 463/919] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 15:01:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:38.023662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e254ea-845e-4989-ab41-14a7e440f560 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:38.023803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d6370-9345-43ac-aa72-b9ba0a1fc838 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:38.028565 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:38.070235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:38.132536 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d6370-9345-43ac-aa72-b9ba0a1fc838 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:38.138087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e254ea-845e-4989-ab41-14a7e440f560 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:38.166817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bfc38-5d86-4190-b65b-532cf3038db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:38.167488 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bfc38-5d86-4190-b65b-532cf3038db3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.167797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bfc38-5d86-4190-b65b-532cf3038db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.168072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bfc38-5d86-4190-b65b-532cf3038db3 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.168852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bfc38-5d86-4190-b65b-532cf3038db3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:38.169385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bfc38-5d86-4190-b65b-532cf3038db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:38.170568 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bfc38-5d86-4190-b65b-532cf3038db3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:38.174502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5965c-8008-4d38-b34e-5e7f848b48d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:38.175180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5965c-8008-4d38-b34e-5e7f848b48d1 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.175980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5965c-8008-4d38-b34e-5e7f848b48d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.176276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5965c-8008-4d38-b34e-5e7f848b48d1 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.177274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5965c-8008-4d38-b34e-5e7f848b48d1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:38.177588 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5965c-8008-4d38-b34e-5e7f848b48d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:38.183429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 464/920] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 15:01:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:38.183593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5965c-8008-4d38-b34e-5e7f848b48d1 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:38.183691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94033f8-6808-4c7d-99e2-00ec946e59e0 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.183691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94033f8-6808-4c7d-99e2-00ec946e59e0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.183691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94033f8-6808-4c7d-99e2-00ec946e59e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.191919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 457/921] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:01:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:38.192565 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5965c-8008-4d38-b34e-5e7f848b48d1 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:38.198740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d94033f8-6808-4c7d-99e2-00ec946e59e0 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:38.199959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d94033f8-6808-4c7d-99e2-00ec946e59e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:38.260890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:38.271719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 465/922] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:38.272875 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94033f8-6808-4c7d-99e2-00ec946e59e0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:38.304858 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5965c-8008-4d38-b34e-5e7f848b48d1 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:38.307984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:38.344978 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7dfb6-4330-4032-af90-7e9daf8567d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:38.345854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7dfb6-4330-4032-af90-7e9daf8567d5 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.346144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7dfb6-4330-4032-af90-7e9daf8567d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.346428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7dfb6-4330-4032-af90-7e9daf8567d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.357589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7dfb6-4330-4032-af90-7e9daf8567d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:38.359138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7dfb6-4330-4032-af90-7e9daf8567d5 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:38.375695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94033f8-6808-4c7d-99e2-00ec946e59e0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-59f7dfb6-4330-4032-af90-7e9daf8567d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:38.376977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:38.377929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:38.378881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:38.378881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:38.378881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:38.378881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:38.378881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 458/923] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:38.379178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7dfb6-4330-4032-af90-7e9daf8567d5 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:38.417910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d10aa0-8bb7-46d9-a53e-4155299daa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:38.418584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d10aa0-8bb7-46d9-a53e-4155299daa6e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.419016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d10aa0-8bb7-46d9-a53e-4155299daa6e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.419140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d10aa0-8bb7-46d9-a53e-4155299daa6e None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.420824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d10aa0-8bb7-46d9-a53e-4155299daa6e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:38.420824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d10aa0-8bb7-46d9-a53e-4155299daa6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:38.423173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d10aa0-8bb7-46d9-a53e-4155299daa6e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:38.428536 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 466/924] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 15:01:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:38.429321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d10aa0-8bb7-46d9-a53e-4155299daa6e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:38.492152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:38.500177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7dfb6-4330-4032-af90-7e9daf8567d5 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:38.538937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11b0e8-be88-4b65-89cf-af9f0076d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:38.539230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d10aa0-8bb7-46d9-a53e-4155299daa6e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:38.540148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11b0e8-be88-4b65-89cf-af9f0076d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.540465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11b0e8-be88-4b65-89cf-af9f0076d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.540717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11b0e8-be88-4b65-89cf-af9f0076d7f9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.541425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11b0e8-be88-4b65-89cf-af9f0076d7f9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:38.542815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11b0e8-be88-4b65-89cf-af9f0076d7f9 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-7c11b0e8-be88-4b65-89cf-af9f0076d7f9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:38.555508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:38.556615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:38.557462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 459/925] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 15:01:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:38.558932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11b0e8-be88-4b65-89cf-af9f0076d7f9 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:38.580578 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8451601-bb19-4699-bd4e-63d8d776be9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:38.581255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8451601-bb19-4699-bd4e-63d8d776be9c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.581542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8451601-bb19-4699-bd4e-63d8d776be9c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.581822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8451601-bb19-4699-bd4e-63d8d776be9c None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.582558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8451601-bb19-4699-bd4e-63d8d776be9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:38.582870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8451601-bb19-4699-bd4e-63d8d776be9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:38.584270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8451601-bb19-4699-bd4e-63d8d776be9c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:38.588896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:38.601591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 467/926] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:38.602500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8451601-bb19-4699-bd4e-63d8d776be9c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:38.678281 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11b0e8-be88-4b65-89cf-af9f0076d7f9 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:38.707180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8451601-bb19-4699-bd4e-63d8d776be9c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:38.713260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d195e-04d9-4a8b-9c7c-3c832051270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:38.713927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d195e-04d9-4a8b-9c7c-3c832051270b None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.714218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d195e-04d9-4a8b-9c7c-3c832051270b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.714500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d195e-04d9-4a8b-9c7c-3c832051270b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.715252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d195e-04d9-4a8b-9c7c-3c832051270b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:38.716674 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d195e-04d9-4a8b-9c7c-3c832051270b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:38.726711 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:38.736347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 460/927] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 15:01:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:38.737091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d195e-04d9-4a8b-9c7c-3c832051270b None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:38.747455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36425fb0-6c8b-44d6-bbc9-4723b2e1b8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:38.748192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36425fb0-6c8b-44d6-bbc9-4723b2e1b8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.748484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36425fb0-6c8b-44d6-bbc9-4723b2e1b8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.748824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36425fb0-6c8b-44d6-bbc9-4723b2e1b8f0 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.749562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36425fb0-6c8b-44d6-bbc9-4723b2e1b8f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:38.749866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36425fb0-6c8b-44d6-bbc9-4723b2e1b8f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:38.751286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36425fb0-6c8b-44d6-bbc9-4723b2e1b8f0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:38.762742 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 468/928] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 15:01:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:38.764132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4e5c-2d92-4b72-bb74-1bda9f71c00e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.764421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4e5c-2d92-4b72-bb74-1bda9f71c00e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.764685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4e5c-2d92-4b72-bb74-1bda9f71c00e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.766569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 469/929] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:38.767428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f4e5c-2d92-4b72-bb74-1bda9f71c00e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:38.833615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:38.864045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d195e-04d9-4a8b-9c7c-3c832051270b None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:38.884560 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f4e5c-2d92-4b72-bb74-1bda9f71c00e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:38.905299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a11fe-0190-404f-b84e-6c2a939c48d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:38.906433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a11fe-0190-404f-b84e-6c2a939c48d6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.906719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a11fe-0190-404f-b84e-6c2a939c48d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.906993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a11fe-0190-404f-b84e-6c2a939c48d6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.916615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a11fe-0190-404f-b84e-6c2a939c48d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:38.918105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a11fe-0190-404f-b84e-6c2a939c48d6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:38.924444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ff3e4-48fb-4fa7-97fb-ef1fdce84fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:38.925284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ff3e4-48fb-4fa7-97fb-ef1fdce84fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.925562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ff3e4-48fb-4fa7-97fb-ef1fdce84fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.925845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ff3e4-48fb-4fa7-97fb-ef1fdce84fd6 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.926592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ff3e4-48fb-4fa7-97fb-ef1fdce84fd6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:38.926883 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ff3e4-48fb-4fa7-97fb-ef1fdce84fd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:38.928288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ff3e4-48fb-4fa7-97fb-ef1fdce84fd6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-fa3a11fe-0190-404f-b84e-6c2a939c48d6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:38.933484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:38.934404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:38.935352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:38.935352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:38.935352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:38.935352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:38.935352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:38.935352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:38.935352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:38.935352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:38.935352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 15:01:38.935352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:38.935953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 470/930] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 15:01:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:38.935953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f96eb-422e-4357-a269-ba400573609a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:38.935953 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f96eb-422e-4357-a269-ba400573609a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:38.936689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f96eb-422e-4357-a269-ba400573609a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:38.939275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 461/931] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 15:01:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:38.940297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a11fe-0190-404f-b84e-6c2a939c48d6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:38.953654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-234f96eb-422e-4357-a269-ba400573609a None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:38.955212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-234f96eb-422e-4357-a269-ba400573609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:38.998638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:39.039858 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 471/932] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:39.039858 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f96eb-422e-4357-a269-ba400573609a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:39.063010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a11fe-0190-404f-b84e-6c2a939c48d6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:39.098665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bec18-a721-4ee3-b758-c4a3fc6501e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:39.099262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bec18-a721-4ee3-b758-c4a3fc6501e2 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:39.099523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bec18-a721-4ee3-b758-c4a3fc6501e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:39.099826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bec18-a721-4ee3-b758-c4a3fc6501e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:39.100625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bec18-a721-4ee3-b758-c4a3fc6501e2 None admin] RBAC: Adding query filter params (interface=public, service_id=faf82910acd247e08b405e401abfece4, region_id=RegionOne) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:39.100934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bec18-a721-4ee3-b758-c4a3fc6501e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:39.102629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bec18-a721-4ee3-b758-c4a3fc6501e2 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:39.105264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:39.113287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 462/933] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 15:01:38 2022] GET /identity/v3/endpoints?service_id=faf82910acd247e08b405e401abfece4&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:39.114069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bec18-a721-4ee3-b758-c4a3fc6501e2 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:39.138777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f96eb-422e-4357-a269-ba400573609a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:39.176038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954dd5aa-df75-4836-ae1c-f7a06be46ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:39.176805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954dd5aa-df75-4836-ae1c-f7a06be46ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:39.177089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954dd5aa-df75-4836-ae1c-f7a06be46ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:39.177370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954dd5aa-df75-4836-ae1c-f7a06be46ef6 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:39.178221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954dd5aa-df75-4836-ae1c-f7a06be46ef6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:39.178577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954dd5aa-df75-4836-ae1c-f7a06be46ef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:39.180070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954dd5aa-df75-4836-ae1c-f7a06be46ef6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:39.202163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 472/934] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 15:01:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:39.202163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954dd5aa-df75-4836-ae1c-f7a06be46ef6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:39.223599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bec18-a721-4ee3-b758-c4a3fc6501e2 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:39.231974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:39.261790 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefce73-1c81-4246-82e8-b47bf1486178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:39.262622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefce73-1c81-4246-82e8-b47bf1486178 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:39.262903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefce73-1c81-4246-82e8-b47bf1486178 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:39.263191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefce73-1c81-4246-82e8-b47bf1486178 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:39.263869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefce73-1c81-4246-82e8-b47bf1486178 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:39.265243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefce73-1c81-4246-82e8-b47bf1486178 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-faefce73-1c81-4246-82e8-b47bf1486178 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:39.277655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:39.278632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:39.279463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 463/935] 10.222.0.24 () {56 vars in 1132 bytes} [Wed May 25 15:01:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:39.280343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefce73-1c81-4246-82e8-b47bf1486178 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:39.311424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954dd5aa-df75-4836-ae1c-f7a06be46ef6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:39.346321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:39.349294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8ef1e-3208-404b-8645-70e82384e5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:39.349910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8ef1e-3208-404b-8645-70e82384e5fc None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:39.350189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8ef1e-3208-404b-8645-70e82384e5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:39.350463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8ef1e-3208-404b-8645-70e82384e5fc None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:39.351163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8ef1e-3208-404b-8645-70e82384e5fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:39.352559 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8ef1e-3208-404b-8645-70e82384e5fc None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:39.358660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 473/936] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 15:01:39 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:39.359437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8ef1e-3208-404b-8645-70e82384e5fc None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:39.405535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefce73-1c81-4246-82e8-b47bf1486178 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:39.470921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d846c-447d-4308-8444-513cabcdc314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:39.472604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d846c-447d-4308-8444-513cabcdc314 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:39.473419 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d846c-447d-4308-8444-513cabcdc314 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:39.473903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d846c-447d-4308-8444-513cabcdc314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:39.489955 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:39.493205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d846c-447d-4308-8444-513cabcdc314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:39.496323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d846c-447d-4308-8444-513cabcdc314 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:39.497274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8ef1e-3208-404b-8645-70e82384e5fc None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-0e6d846c-447d-4308-8444-513cabcdc314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:39.522192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:39.523178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:39.524104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:39.524104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:39.524104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:39.524104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:39.529388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 464/937] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:39.530554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d846c-447d-4308-8444-513cabcdc314 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:39.546053 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366aa07e-3182-4beb-b9ed-d24856c97c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:39.546986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366aa07e-3182-4beb-b9ed-d24856c97c44 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:39.547270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366aa07e-3182-4beb-b9ed-d24856c97c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:39.547551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366aa07e-3182-4beb-b9ed-d24856c97c44 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:39.548319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366aa07e-3182-4beb-b9ed-d24856c97c44 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:39.548626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366aa07e-3182-4beb-b9ed-d24856c97c44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:39.550885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366aa07e-3182-4beb-b9ed-d24856c97c44 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:39.557934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 474/938] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 15:01:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:39.562827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366aa07e-3182-4beb-b9ed-d24856c97c44 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:39.656995 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d846c-447d-4308-8444-513cabcdc314 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:39.675907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:39.690927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366aa07e-3182-4beb-b9ed-d24856c97c44 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:39.695310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba4c8c-801a-4fa6-829f-f2943ba87c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:39.696207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba4c8c-801a-4fa6-829f-f2943ba87c7a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:39.696662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba4c8c-801a-4fa6-829f-f2943ba87c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:39.697103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba4c8c-801a-4fa6-829f-f2943ba87c7a None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:39.698001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba4c8c-801a-4fa6-829f-f2943ba87c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:39.698497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba4c8c-801a-4fa6-829f-f2943ba87c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:39.700085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba4c8c-801a-4fa6-829f-f2943ba87c7a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:39.719364 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 465/939] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:39.720275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba4c8c-801a-4fa6-829f-f2943ba87c7a None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:39.733484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d3a81-8e2a-4696-8924-dec3f8d92c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:39.734797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d3a81-8e2a-4696-8924-dec3f8d92c43 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:39.735261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d3a81-8e2a-4696-8924-dec3f8d92c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:39.735748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d3a81-8e2a-4696-8924-dec3f8d92c43 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:39.736688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d3a81-8e2a-4696-8924-dec3f8d92c43 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:39.737179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d3a81-8e2a-4696-8924-dec3f8d92c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:39.738766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d3a81-8e2a-4696-8924-dec3f8d92c43 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:39.748747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 475/940] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 15:01:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:39.749895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d3a81-8e2a-4696-8924-dec3f8d92c43 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:39.776060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:39.843290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba4c8c-801a-4fa6-829f-f2943ba87c7a None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:39.853412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d3a81-8e2a-4696-8924-dec3f8d92c43 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:39.888991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe79b0-db53-4568-9d6f-b62db423223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:39.889804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe79b0-db53-4568-9d6f-b62db423223d None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:39.890095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe79b0-db53-4568-9d6f-b62db423223d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:39.890366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe79b0-db53-4568-9d6f-b62db423223d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:39.893027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905264a3-89ab-4b99-a416-fa87b5ea5501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:39.893907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905264a3-89ab-4b99-a416-fa87b5ea5501 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:39.894359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905264a3-89ab-4b99-a416-fa87b5ea5501 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:39.894798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905264a3-89ab-4b99-a416-fa87b5ea5501 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:39.895762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905264a3-89ab-4b99-a416-fa87b5ea5501 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:39.897339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905264a3-89ab-4b99-a416-fa87b5ea5501 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:39.897762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe79b0-db53-4568-9d6f-b62db423223d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:39.899231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe79b0-db53-4568-9d6f-b62db423223d None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-ccfe79b0-db53-4568-9d6f-b62db423223d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:39.916516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:39.917504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:39.918409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:39.918409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:39.918409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:39.918409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:39.918409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:39.918409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:39.918409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:39.918409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:39.921538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 476/941] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 15:01:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:39.922796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 466/942] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:39.923901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905264a3-89ab-4b99-a416-fa87b5ea5501 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:40.019749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:40.049947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905264a3-89ab-4b99-a416-fa87b5ea5501 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:40.088306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caacc9-54fa-40e4-9121-15be5bb61ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:40.089415 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caacc9-54fa-40e4-9121-15be5bb61ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:40.089963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caacc9-54fa-40e4-9121-15be5bb61ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:40.090447 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caacc9-54fa-40e4-9121-15be5bb61ec6 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:40.091516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0caacc9-54fa-40e4-9121-15be5bb61ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:40.092048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0caacc9-54fa-40e4-9121-15be5bb61ec6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:40.093753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0caacc9-54fa-40e4-9121-15be5bb61ec6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:40.111928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 477/943] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:40.117485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe79b0-db53-4568-9d6f-b62db423223d None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:40.155497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:40.222327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe79b0-db53-4568-9d6f-b62db423223d None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:40.257621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c96ed3-e04e-4243-9695-a608a14015ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:40.258518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c96ed3-e04e-4243-9695-a608a14015ee None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:40.258798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c96ed3-e04e-4243-9695-a608a14015ee None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:40.259077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c96ed3-e04e-4243-9695-a608a14015ee None admin] PATH_INFO: `/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/042393fa408b45208021befccd6bd800/roles/b25816a24b4b4ca48ca941a6d06fe5b3` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:40.261325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c96ed3-e04e-4243-9695-a608a14015ee None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ad2e4552f43f09ebf85b6c82a5481, user_id=042393fa408b45208021befccd6bd800, role_id=b25816a24b4b4ca48ca941a6d06fe5b3)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:40.262779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c96ed3-e04e-4243-9695-a608a14015ee None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:40.277559 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 467/944] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:01:40 2022] PUT /identity/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/042393fa408b45208021befccd6bd800/roles/b25816a24b4b4ca48ca941a6d06fe5b3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:01:40.966285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7254df-4272-4f9e-95e2-3104f9f19c38 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:40.966822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7254df-4272-4f9e-95e2-3104f9f19c38 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:40.966822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7254df-4272-4f9e-95e2-3104f9f19c38 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:40.968451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 478/945] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:40.973835 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1fb13-c6be-4c2d-be65-4831f8f555c1 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:40.974245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1fb13-c6be-4c2d-be65-4831f8f555c1 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:40.974411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1fb13-c6be-4c2d-be65-4831f8f555c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:40.991418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-44c1fb13-c6be-4c2d-be65-4831f8f555c1 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:40.992620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-44c1fb13-c6be-4c2d-be65-4831f8f555c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:41.059048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 468/946] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:41.082196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7254df-4272-4f9e-95e2-3104f9f19c38 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:41.187520 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7254df-4272-4f9e-95e2-3104f9f19c38 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:41.226400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffebb5-f9c7-4ad6-829b-6c34f66d42cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:41.226985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffebb5-f9c7-4ad6-829b-6c34f66d42cb None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:41.227390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffebb5-f9c7-4ad6-829b-6c34f66d42cb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:41.227676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffebb5-f9c7-4ad6-829b-6c34f66d42cb None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:41.228407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffebb5-f9c7-4ad6-829b-6c34f66d42cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:41.229884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffebb5-f9c7-4ad6-829b-6c34f66d42cb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:41.231254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: WARNING keystone.server.flask.common [None req-b9ffebb5-f9c7-4ad6-829b-6c34f66d42cb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 15:01:41.235706 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:41.249831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.sql.core [None req-b9ffebb5-f9c7-4ad6-829b-6c34f66d42cb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 15:01:41.249831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 15:01:41.249831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [parameters: {'id': '77e85557623740b283372de87515264e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 15:01:41.249831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80326) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b9ffebb5-f9c7-4ad6-829b-6c34f66d42cb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 77e85557623740b283372de87515264e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 77e85557623740b283372de87515264e. May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application conn.query(q) May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:01:41.267115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application result.read() May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 15:01:41.268095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application next(self.gen) May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application yield resource May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application next(self.gen) May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.session.rollback() May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.force_reraise() May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise self.value May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application session.commit() May 25 15:01:41.269493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._prepare_impl() May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.session.flush() May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._flush(objects) May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application compat.raise_( May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application flush_context.execute() May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 15:01:41.271100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rec.execute(self) May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 15:01:41.272337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application conn.query(q) May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application result.read() May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:01:41.275644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [parameters: {'id': '77e85557623740b283372de87515264e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:41.276609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:41.277385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:41.278282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:41.278282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 15:01:41.278282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 15:01:41.278282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:41.278282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:41.278282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 15:01:41.278282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 15:01:41.278282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 77e85557623740b283372de87515264e. May 25 15:01:41.278282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:41.278282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 479/947] 10.222.0.24 () {60 vars in 1140 bytes} [Wed May 25 15:01:41 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:41.278841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1fb13-c6be-4c2d-be65-4831f8f555c1 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:41.310289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:41.385308 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1fb13-c6be-4c2d-be65-4831f8f555c1 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:41.422549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406a212-546b-41d5-9f2f-c345b3397dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:41.423828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406a212-546b-41d5-9f2f-c345b3397dcf None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:41.424340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406a212-546b-41d5-9f2f-c345b3397dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:41.424865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406a212-546b-41d5-9f2f-c345b3397dcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:41.432060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406a212-546b-41d5-9f2f-c345b3397dcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:41.439386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406a212-546b-41d5-9f2f-c345b3397dcf None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-b406a212-546b-41d5-9f2f-c345b3397dcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:41.460609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:41.461528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:41.462425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:41.462425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:41.462425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:41.462425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:41.462425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:41.462425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:41.462425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:41.462425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:41.464947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 469/948] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:41.470676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffebb5-f9c7-4ad6-829b-6c34f66d42cb None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:41.583453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffebb5-f9c7-4ad6-829b-6c34f66d42cb None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:41.617998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14793b36-bd88-4583-ab9a-c4cee7f6f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:41.619009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14793b36-bd88-4583-ab9a-c4cee7f6f326 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:41.619503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14793b36-bd88-4583-ab9a-c4cee7f6f326 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:41.620010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14793b36-bd88-4583-ab9a-c4cee7f6f326 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:41.620973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14793b36-bd88-4583-ab9a-c4cee7f6f326 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:41.621482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14793b36-bd88-4583-ab9a-c4cee7f6f326 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:41.623309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14793b36-bd88-4583-ab9a-c4cee7f6f326 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:41.644470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 480/949] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:41.682796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65483b6-8a36-4436-a956-6dd4520e15a5 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:41.683127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65483b6-8a36-4436-a956-6dd4520e15a5 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:41.683408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65483b6-8a36-4436-a956-6dd4520e15a5 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:41.685221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 470/950] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:41.691290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159e32e-c93b-4907-b6aa-e28f2ea29b7a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:41.691636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159e32e-c93b-4907-b6aa-e28f2ea29b7a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:41.691910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159e32e-c93b-4907-b6aa-e28f2ea29b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:41.710752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9159e32e-c93b-4907-b6aa-e28f2ea29b7a None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:41.712364 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9159e32e-c93b-4907-b6aa-e28f2ea29b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:41.768252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:41.791183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 481/951] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:41.816530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65483b6-8a36-4436-a956-6dd4520e15a5 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:41.921585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:41.938223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65483b6-8a36-4436-a956-6dd4520e15a5 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:41.973701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b35ae-2b16-42ef-945e-f4198b0c18e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:41.974522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b35ae-2b16-42ef-945e-f4198b0c18e5 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:41.975125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b35ae-2b16-42ef-945e-f4198b0c18e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:41.975125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b35ae-2b16-42ef-945e-f4198b0c18e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:41.975744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b35ae-2b16-42ef-945e-f4198b0c18e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:41.977426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b35ae-2b16-42ef-945e-f4198b0c18e5 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-680b35ae-2b16-42ef-945e-f4198b0c18e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:41.990141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:41.991684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:41.992836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 471/952] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 15:01:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:42.000179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159e32e-c93b-4907-b6aa-e28f2ea29b7a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:42.111598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159e32e-c93b-4907-b6aa-e28f2ea29b7a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:42.145937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688f9ce-7aa0-4d77-8b90-368db09239ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:42.146610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688f9ce-7aa0-4d77-8b90-368db09239ab None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:42.146890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688f9ce-7aa0-4d77-8b90-368db09239ab None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:42.147165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688f9ce-7aa0-4d77-8b90-368db09239ab None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:42.147913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688f9ce-7aa0-4d77-8b90-368db09239ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:42.148217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688f9ce-7aa0-4d77-8b90-368db09239ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:42.149581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688f9ce-7aa0-4d77-8b90-368db09239ab None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:42.154923 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 482/953] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 15:01:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:42.160829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b35ae-2b16-42ef-945e-f4198b0c18e5 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:42.270451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b35ae-2b16-42ef-945e-f4198b0c18e5 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:42.271826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcebd3-c3e4-4be1-bc00-4e5c431179ce None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:42.272138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcebd3-c3e4-4be1-bc00-4e5c431179ce None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:42.272379 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcebd3-c3e4-4be1-bc00-4e5c431179ce None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:42.274731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 483/954] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:42.279139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71447c53-00e1-41f4-bdc6-343f2ddf933d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:42.279426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71447c53-00e1-41f4-bdc6-343f2ddf933d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:42.279734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71447c53-00e1-41f4-bdc6-343f2ddf933d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:42.297815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-71447c53-00e1-41f4-bdc6-343f2ddf933d None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:42.299037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-71447c53-00e1-41f4-bdc6-343f2ddf933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:42.313399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f938e22-f659-4029-941e-c01a3f8c1e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:42.314492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f938e22-f659-4029-941e-c01a3f8c1e50 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:42.314985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f938e22-f659-4029-941e-c01a3f8c1e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:42.315535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f938e22-f659-4029-941e-c01a3f8c1e50 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:42.316526 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f938e22-f659-4029-941e-c01a3f8c1e50 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:42.317075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f938e22-f659-4029-941e-c01a3f8c1e50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:42.318825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f938e22-f659-4029-941e-c01a3f8c1e50 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:42.329823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 472/955] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 15:01:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:42.331513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f938e22-f659-4029-941e-c01a3f8c1e50 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:42.349723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:42.350478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:42.383639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 484/956] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:42.399140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71447c53-00e1-41f4-bdc6-343f2ddf933d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:42.441736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f938e22-f659-4029-941e-c01a3f8c1e50 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:42.477626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb30af-a9ee-4222-bb0e-9ced77325599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:42.478329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb30af-a9ee-4222-bb0e-9ced77325599 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:42.478619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb30af-a9ee-4222-bb0e-9ced77325599 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:42.478903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb30af-a9ee-4222-bb0e-9ced77325599 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:42.479697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb30af-a9ee-4222-bb0e-9ced77325599 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:42.481089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb30af-a9ee-4222-bb0e-9ced77325599 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:42.501848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 473/957] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 15:01:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:01:42.503405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841791-6e69-43cb-bb28-4d6586defd65 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:42.503753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841791-6e69-43cb-bb28-4d6586defd65 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:42.504039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841791-6e69-43cb-bb28-4d6586defd65 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:42.505622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 474/958] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:42.511363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3802216-fbf3-4865-8b85-14e48b8b1f67 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:42.512001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3802216-fbf3-4865-8b85-14e48b8b1f67 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:42.512287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3802216-fbf3-4865-8b85-14e48b8b1f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:42.518125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71447c53-00e1-41f4-bdc6-343f2ddf933d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:42.535693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-d3802216-fbf3-4865-8b85-14e48b8b1f67 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:42.537457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-d3802216-fbf3-4865-8b85-14e48b8b1f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:42.568830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeafe1f-a799-44be-af4d-526cf29355f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:42.570098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeafe1f-a799-44be-af4d-526cf29355f1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:42.570629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeafe1f-a799-44be-af4d-526cf29355f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:42.571059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeafe1f-a799-44be-af4d-526cf29355f1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:42.572088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeafe1f-a799-44be-af4d-526cf29355f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:42.574111 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeafe1f-a799-44be-af4d-526cf29355f1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-aeeafe1f-a799-44be-af4d-526cf29355f1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:42.587911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:42.589170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:01:42.590026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:42.592889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 485/959] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:42.598762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeafe1f-a799-44be-af4d-526cf29355f1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:42.618737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:42.628861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 475/960] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:42.652214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:42.652535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3802216-fbf3-4865-8b85-14e48b8b1f67 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:42.720662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeafe1f-a799-44be-af4d-526cf29355f1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:42.762439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfee295-8cd6-45b8-acce-040d692bc614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:42.763113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfee295-8cd6-45b8-acce-040d692bc614 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:42.763394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfee295-8cd6-45b8-acce-040d692bc614 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:42.763726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfee295-8cd6-45b8-acce-040d692bc614 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:42.764888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfee295-8cd6-45b8-acce-040d692bc614 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:42.765199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfee295-8cd6-45b8-acce-040d692bc614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:42.766760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfee295-8cd6-45b8-acce-040d692bc614 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:42.774088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 486/961] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:42.779829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfee295-8cd6-45b8-acce-040d692bc614 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:42.780378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3802216-fbf3-4865-8b85-14e48b8b1f67 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:42.831621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5129-94cc-4896-ac92-b7de252cceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:42.832986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5129-94cc-4896-ac92-b7de252cceff None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:42.833688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5129-94cc-4896-ac92-b7de252cceff None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:42.834157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5129-94cc-4896-ac92-b7de252cceff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:42.848804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c5129-94cc-4896-ac92-b7de252cceff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-f64c5129-94cc-4896-ac92-b7de252cceff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:42.860131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:42.861170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:42.862051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:42.862051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:42.862051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:42.862051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:42.862051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:42.862051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:42.862051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:42.862051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:42.862051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:42.862051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:42.862051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 15:01:42.862051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:42.869912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 476/962] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 15:01:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:42.871191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5129-94cc-4896-ac92-b7de252cceff None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:42.898708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:42.904163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfee295-8cd6-45b8-acce-040d692bc614 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:42.938958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:42.946784 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6787e-73f0-4d7f-89ad-65e88dbad73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:42.947974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6787e-73f0-4d7f-89ad-65e88dbad73c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:42.949278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6787e-73f0-4d7f-89ad-65e88dbad73c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:42.949779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6787e-73f0-4d7f-89ad-65e88dbad73c None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:42.950712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6787e-73f0-4d7f-89ad-65e88dbad73c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:42.951220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6787e-73f0-4d7f-89ad-65e88dbad73c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:42.952826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6787e-73f0-4d7f-89ad-65e88dbad73c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:42.959911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 487/963] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:42.987607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5129-94cc-4896-ac92-b7de252cceff None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:43.026239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbb296-fa8a-45eb-9de8-83ffbdf0ea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:43.026992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbb296-fa8a-45eb-9de8-83ffbdf0ea35 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:43.027281 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbb296-fa8a-45eb-9de8-83ffbdf0ea35 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:43.027646 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbb296-fa8a-45eb-9de8-83ffbdf0ea35 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:43.028443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbb296-fa8a-45eb-9de8-83ffbdf0ea35 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:43.028757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbb296-fa8a-45eb-9de8-83ffbdf0ea35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:43.030187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbb296-fa8a-45eb-9de8-83ffbdf0ea35 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:43.040015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 477/964] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 15:01:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:43.048720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6787e-73f0-4d7f-89ad-65e88dbad73c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:43.166589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6787e-73f0-4d7f-89ad-65e88dbad73c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:43.201080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f47512-a07c-47cf-ae63-148a35265273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:43.201882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f47512-a07c-47cf-ae63-148a35265273 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:43.202164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f47512-a07c-47cf-ae63-148a35265273 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:43.202436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f47512-a07c-47cf-ae63-148a35265273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:43.213641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f47512-a07c-47cf-ae63-148a35265273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:43.215073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f47512-a07c-47cf-ae63-148a35265273 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-f5f47512-a07c-47cf-ae63-148a35265273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:43.232517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:43.233441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:43.234404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:43.234404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:43.234404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:43.234404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:43.234404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 488/965] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:43.241214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbb296-fa8a-45eb-9de8-83ffbdf0ea35 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:43.347407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbb296-fa8a-45eb-9de8-83ffbdf0ea35 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:43.375933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:43.383643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49272416-ddab-4648-af07-abd89970e433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:43.384556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49272416-ddab-4648-af07-abd89970e433 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:43.384844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49272416-ddab-4648-af07-abd89970e433 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:43.385128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49272416-ddab-4648-af07-abd89970e433 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:43.385873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49272416-ddab-4648-af07-abd89970e433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:43.386185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49272416-ddab-4648-af07-abd89970e433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:43.387584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49272416-ddab-4648-af07-abd89970e433 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:43.400513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 478/966] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:43.406080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f47512-a07c-47cf-ae63-148a35265273 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:43.428542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:43.514696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f47512-a07c-47cf-ae63-148a35265273 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:43.549437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a938bb-d6ed-468b-a540-8985ce71cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:43.550298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a938bb-d6ed-468b-a540-8985ce71cf51 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:43.550582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a938bb-d6ed-468b-a540-8985ce71cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:43.550861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a938bb-d6ed-468b-a540-8985ce71cf51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:43.559037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a938bb-d6ed-468b-a540-8985ce71cf51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:43.560515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a938bb-d6ed-468b-a540-8985ce71cf51 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a8a938bb-d6ed-468b-a540-8985ce71cf51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:43.577348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:43.578314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:43.579243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:43.579243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:43.579243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:43.579243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:43.579243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:43.579243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:43.579243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:43.579243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:43.579243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 15:01:43.579243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:43.579243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 489/967] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 15:01:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:43.584857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49272416-ddab-4648-af07-abd89970e433 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:43.691020 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49272416-ddab-4648-af07-abd89970e433 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:43.725548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e51da-cd05-4cf9-9292-303798665a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:43.726236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e51da-cd05-4cf9-9292-303798665a48 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:43.726520 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e51da-cd05-4cf9-9292-303798665a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:43.726798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e51da-cd05-4cf9-9292-303798665a48 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:43.727699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e51da-cd05-4cf9-9292-303798665a48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:43.728008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e51da-cd05-4cf9-9292-303798665a48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:43.729469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e51da-cd05-4cf9-9292-303798665a48 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:43.751132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 479/968] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 15:01:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:43.756542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a938bb-d6ed-468b-a540-8985ce71cf51 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:43.844027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:43.868103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a938bb-d6ed-468b-a540-8985ce71cf51 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:43.902675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504b6d3-cd47-4eb9-b9a0-d9225bff1a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:43.903337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504b6d3-cd47-4eb9-b9a0-d9225bff1a6d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:43.903654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504b6d3-cd47-4eb9-b9a0-d9225bff1a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:43.903938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504b6d3-cd47-4eb9-b9a0-d9225bff1a6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:43.973510 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504b6d3-cd47-4eb9-b9a0-d9225bff1a6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:43.974879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504b6d3-cd47-4eb9-b9a0-d9225bff1a6d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:43.980049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a745661-e71b-4a84-bde4-d2fbfaef66f5 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:43.980598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a745661-e71b-4a84-bde4-d2fbfaef66f5 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:43.981104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a745661-e71b-4a84-bde4-d2fbfaef66f5 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:43.982899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 480/969] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:43.987965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b3a8f-f70d-43d1-82ce-52b89d6d2428 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:43.988891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b3a8f-f70d-43d1-82ce-52b89d6d2428 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:43.989362 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b3a8f-f70d-43d1-82ce-52b89d6d2428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:44.006532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-ea1b3a8f-f70d-43d1-82ce-52b89d6d2428 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:44.008046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-ea1b3a8f-f70d-43d1-82ce-52b89d6d2428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:44.042255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:44.082697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 481/970] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:44.091949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:44.092396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 490/971] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:43 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:01:44.098346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b3a8f-f70d-43d1-82ce-52b89d6d2428 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:44.105846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504b6d3-cd47-4eb9-b9a0-d9225bff1a6d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:44.212029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504b6d3-cd47-4eb9-b9a0-d9225bff1a6d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:44.235636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b3a8f-f70d-43d1-82ce-52b89d6d2428 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:44.259586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dc0c4-df81-4e33-8295-6fdff9f87675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:44.259586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dc0c4-df81-4e33-8295-6fdff9f87675 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:44.259586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dc0c4-df81-4e33-8295-6fdff9f87675 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:44.259586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dc0c4-df81-4e33-8295-6fdff9f87675 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:44.260187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dc0c4-df81-4e33-8295-6fdff9f87675 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:44.262310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dc0c4-df81-4e33-8295-6fdff9f87675 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:44.271672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a653a30-317c-401f-b4aa-01a764922e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:44.272480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a653a30-317c-401f-b4aa-01a764922e5c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:44.272764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a653a30-317c-401f-b4aa-01a764922e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:44.273040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a653a30-317c-401f-b4aa-01a764922e5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:44.278599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.sql.core [None req-2b4dc0c4-df81-4e33-8295-6fdff9f87675 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 15:01:44.278599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 15:01:44.278599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [parameters: {'user_id': 'ad5296c08bcb4c9eafd1ccab08231097', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 15:01:44.278599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80326) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 15:01:44.283970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a653a30-317c-401f-b4aa-01a764922e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:44.285603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a653a30-317c-401f-b4aa-01a764922e5c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2b4dc0c4-df81-4e33-8295-6fdff9f87675 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application conn.query(q) May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application result.read() May 25 15:01:44.289138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:01:44.290023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application next(self.gen) May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application yield resource May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application next(self.gen) May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.session.rollback() May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.force_reraise() May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise self.value May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application session.commit() May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 15:01:44.290980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._prepare_impl() May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.session.flush() May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._flush(objects) May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application compat.raise_( May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application flush_context.execute() May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rec.execute(self) May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 15:01:44.292239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:01:44.293248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application conn.query(q) May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application result.read() May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:01:44.294097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ad5296c08bcb4c9eafd1ccab08231097', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:44.294939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 15:01:44.301178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 15:01:44.303497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 15:01:44.303497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 15:01:44.303497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 15:01:44.303497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 15:01:44.303497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 15:01:44.303497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:44.303497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 491/972] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 15:01:44 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-1a653a30-317c-401f-b4aa-01a764922e5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:44.307212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:44.309141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:44.313371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:44.313371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:44.313371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:44.313371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:44.313371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 482/973] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:44.313713 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dc0c4-df81-4e33-8295-6fdff9f87675 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:44.316714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a653a30-317c-401f-b4aa-01a764922e5c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:44.354606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:44.355650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:44.424841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dc0c4-df81-4e33-8295-6fdff9f87675 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:44.452678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a653a30-317c-401f-b4aa-01a764922e5c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:44.474483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb8f26-692f-4a6a-b518-490ab200de14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:44.475339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb8f26-692f-4a6a-b518-490ab200de14 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:44.475656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb8f26-692f-4a6a-b518-490ab200de14 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:44.475922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb8f26-692f-4a6a-b518-490ab200de14 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:44.484737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb8f26-692f-4a6a-b518-490ab200de14 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:44.486314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb8f26-692f-4a6a-b518-490ab200de14 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:44.490191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594bba-acc8-46b0-ab69-2e55bd4f50c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:44.491097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594bba-acc8-46b0-ab69-2e55bd4f50c9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:44.491616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594bba-acc8-46b0-ab69-2e55bd4f50c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:44.492094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594bba-acc8-46b0-ab69-2e55bd4f50c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:44.493039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd594bba-acc8-46b0-ab69-2e55bd4f50c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:44.493543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd594bba-acc8-46b0-ab69-2e55bd4f50c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:44.495102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd594bba-acc8-46b0-ab69-2e55bd4f50c9 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-64fb8f26-692f-4a6a-b518-490ab200de14 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:44.500873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:44.501824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:44.502773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:44.502773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:44.502773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:44.502773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:44.502773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:44.502773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:44.502773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:44.502773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:44.502773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:01:44.502773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:44.507964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 492/974] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:01:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:44.508989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb8f26-692f-4a6a-b518-490ab200de14 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:44.511131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 483/975] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:44.516600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594bba-acc8-46b0-ab69-2e55bd4f50c9 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:44.599243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:44.622659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:44.627614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594bba-acc8-46b0-ab69-2e55bd4f50c9 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:44.628539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb8f26-692f-4a6a-b518-490ab200de14 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:44.666177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc85a5-ac99-4fdd-b339-015580b45db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:44.667434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc85a5-ac99-4fdd-b339-015580b45db3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:44.667931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc85a5-ac99-4fdd-b339-015580b45db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:44.668406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc85a5-ac99-4fdd-b339-015580b45db3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:44.671148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa23797-8171-439d-8e39-07c2046066af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:44.672343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa23797-8171-439d-8e39-07c2046066af None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:44.672770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa23797-8171-439d-8e39-07c2046066af None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:44.673282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa23797-8171-439d-8e39-07c2046066af None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:44.674254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa23797-8171-439d-8e39-07c2046066af None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:44.674697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa23797-8171-439d-8e39-07c2046066af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:44.676324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc85a5-ac99-4fdd-b339-015580b45db3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:44.676764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa23797-8171-439d-8e39-07c2046066af None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:44.678021 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc85a5-ac99-4fdd-b339-015580b45db3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-15bc85a5-ac99-4fdd-b339-015580b45db3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:44.692895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:44.694012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:44.695162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:44.695162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:44.695162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:44.695162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:44.695162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:44.695162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:44.695162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:44.695162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:44.701466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 484/976] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:44.702407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc85a5-ac99-4fdd-b339-015580b45db3 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:44.731956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 493/977] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 15:01:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:44.819851 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc85a5-ac99-4fdd-b339-015580b45db3 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:44.863465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba7a3e-00e3-4cee-962e-db477a29a0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:44.864606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba7a3e-00e3-4cee-962e-db477a29a0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:44.865093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba7a3e-00e3-4cee-962e-db477a29a0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:44.865558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba7a3e-00e3-4cee-962e-db477a29a0a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:44.866566 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba7a3e-00e3-4cee-962e-db477a29a0a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:44.867099 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba7a3e-00e3-4cee-962e-db477a29a0a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:44.868800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba7a3e-00e3-4cee-962e-db477a29a0a9 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:44.884384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 485/978] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:44.893298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa23797-8171-439d-8e39-07c2046066af None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:44.932212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424ea36-4c22-4bfb-9ded-1c3874c4b91d None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:44.932539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424ea36-4c22-4bfb-9ded-1c3874c4b91d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:44.932843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424ea36-4c22-4bfb-9ded-1c3874c4b91d None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:44.934589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 486/979] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:44.940446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951b2bd-16a1-476d-8bfd-6ec186b38281 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:44.940764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951b2bd-16a1-476d-8bfd-6ec186b38281 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:44.941134 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951b2bd-16a1-476d-8bfd-6ec186b38281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:44.948129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:44.965537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-e951b2bd-16a1-476d-8bfd-6ec186b38281 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:44.967037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-e951b2bd-16a1-476d-8bfd-6ec186b38281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:45.008628 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa23797-8171-439d-8e39-07c2046066af None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:45.054218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d3d3a-42f1-4b13-81dd-624ab6d322a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:45.054880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d3d3a-42f1-4b13-81dd-624ab6d322a6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:45.055161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d3d3a-42f1-4b13-81dd-624ab6d322a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:45.055434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d3d3a-42f1-4b13-81dd-624ab6d322a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:45.056320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d3d3a-42f1-4b13-81dd-624ab6d322a6 None admin] RBAC: Adding query filter params (role.id=b25816a24b4b4ca48ca941a6d06fe5b3, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=042393fa408b45208021befccd6bd800) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:45.056633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d3d3a-42f1-4b13-81dd-624ab6d322a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:45.058071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d3d3a-42f1-4b13-81dd-624ab6d322a6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:45.060178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 487/980] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:45.070796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 494/981] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:44 2022] GET /identity/v3/role_assignments?user.id=042393fa408b45208021befccd6bd800&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=b25816a24b4b4ca48ca941a6d06fe5b3 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:45.085060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951b2bd-16a1-476d-8bfd-6ec186b38281 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:45.207947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951b2bd-16a1-476d-8bfd-6ec186b38281 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:45.241440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:45.247882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678b316-e905-40b8-960e-4373fd70626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:45.248707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678b316-e905-40b8-960e-4373fd70626c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:45.248989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678b316-e905-40b8-960e-4373fd70626c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:45.249264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678b316-e905-40b8-960e-4373fd70626c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:45.249936 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678b316-e905-40b8-960e-4373fd70626c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:45.251324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678b316-e905-40b8-960e-4373fd70626c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-0678b316-e905-40b8-960e-4373fd70626c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:45.264187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:45.265284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:45.266157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 488/982] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 15:01:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:45.274066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d3d3a-42f1-4b13-81dd-624ab6d322a6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:45.298631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:45.340928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c3a52-043c-45d0-bd21-40c0b6dd6c99 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:45.341219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c3a52-043c-45d0-bd21-40c0b6dd6c99 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:45.341429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c3a52-043c-45d0-bd21-40c0b6dd6c99 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:45.342793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 489/983] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:45.347842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db02a1a-a288-43c5-9550-9fcd723e31b7 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:45.348135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db02a1a-a288-43c5-9550-9fcd723e31b7 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:45.348420 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db02a1a-a288-43c5-9550-9fcd723e31b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:45.366424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-1db02a1a-a288-43c5-9550-9fcd723e31b7 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:45.367957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-1db02a1a-a288-43c5-9550-9fcd723e31b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:45.385279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d3d3a-42f1-4b13-81dd-624ab6d322a6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:45.422338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ef490-f72c-4c07-aa98-8463fda663ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:45.423040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ef490-f72c-4c07-aa98-8463fda663ba None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:45.423432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ef490-f72c-4c07-aa98-8463fda663ba None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:45.423743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ef490-f72c-4c07-aa98-8463fda663ba None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:45.424584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ef490-f72c-4c07-aa98-8463fda663ba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:45.424893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ef490-f72c-4c07-aa98-8463fda663ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:45.426316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ef490-f72c-4c07-aa98-8463fda663ba None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:45.431648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 495/984] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 15:01:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:45.438496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ef490-f72c-4c07-aa98-8463fda663ba None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:45.439755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 490/985] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:45.461975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db02a1a-a288-43c5-9550-9fcd723e31b7 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:45.529651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:45.547547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ef490-f72c-4c07-aa98-8463fda663ba None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:45.563415 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db02a1a-a288-43c5-9550-9fcd723e31b7 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:45.589244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:45.591449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e50304-a2bb-46f0-a45b-0b56b8ed40a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:45.592100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e50304-a2bb-46f0-a45b-0b56b8ed40a3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:45.592380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e50304-a2bb-46f0-a45b-0b56b8ed40a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:45.592655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e50304-a2bb-46f0-a45b-0b56b8ed40a3 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:45.593373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e50304-a2bb-46f0-a45b-0b56b8ed40a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:45.593680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e50304-a2bb-46f0-a45b-0b56b8ed40a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:45.595043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e50304-a2bb-46f0-a45b-0b56b8ed40a3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:45.600350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 496/986] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 15:01:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:45.606052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e50304-a2bb-46f0-a45b-0b56b8ed40a3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:45.607489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8209c-aa0f-4f2c-9484-8881d08d439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:45.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8209c-aa0f-4f2c-9484-8881d08d439b None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:45.608482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8209c-aa0f-4f2c-9484-8881d08d439b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:45.608759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8209c-aa0f-4f2c-9484-8881d08d439b None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:45.609493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8209c-aa0f-4f2c-9484-8881d08d439b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:45.610876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8209c-aa0f-4f2c-9484-8881d08d439b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:45.625889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 491/987] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 15:01:45 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:01:45.721253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e50304-a2bb-46f0-a45b-0b56b8ed40a3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:45.767610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb19fe-725e-49cb-97d2-9974f3a79653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:45.768317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb19fe-725e-49cb-97d2-9974f3a79653 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:45.768601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb19fe-725e-49cb-97d2-9974f3a79653 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:45.768882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb19fe-725e-49cb-97d2-9974f3a79653 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:45.769750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb19fe-725e-49cb-97d2-9974f3a79653 None admin] RBAC: Adding query filter params (interface=admin, service_id=faf82910acd247e08b405e401abfece4, region_id=RegionOne) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:45.770069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb19fe-725e-49cb-97d2-9974f3a79653 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:45.771445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb19fe-725e-49cb-97d2-9974f3a79653 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:45.780343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 497/988] 10.222.0.24 () {56 vars in 1249 bytes} [Wed May 25 15:01:45 2022] GET /identity/v3/endpoints?service_id=faf82910acd247e08b405e401abfece4&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:45.785934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8209c-aa0f-4f2c-9484-8881d08d439b None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:45.895434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8209c-aa0f-4f2c-9484-8881d08d439b None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:45.931245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53965391-30c4-4e63-b2f8-2f9a99b3adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:45.931958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53965391-30c4-4e63-b2f8-2f9a99b3adfb None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:45.932242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53965391-30c4-4e63-b2f8-2f9a99b3adfb None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:45.932521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53965391-30c4-4e63-b2f8-2f9a99b3adfb None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:45.933216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53965391-30c4-4e63-b2f8-2f9a99b3adfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:45.934610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53965391-30c4-4e63-b2f8-2f9a99b3adfb None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:45.941417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 492/989] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 15:01:45 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:01:47.278577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e499062-70e1-4c5e-bb67-0c330cb7fad2 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:47.279132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e499062-70e1-4c5e-bb67-0c330cb7fad2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:47.279132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e499062-70e1-4c5e-bb67-0c330cb7fad2 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:47.280498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 498/990] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:47.286079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b5725-8a30-40fe-8463-c0b0334109c7 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:47.286488 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b5725-8a30-40fe-8463-c0b0334109c7 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:47.286656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b5725-8a30-40fe-8463-c0b0334109c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:47.304339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-292b5725-8a30-40fe-8463-c0b0334109c7 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:47.305499 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-292b5725-8a30-40fe-8463-c0b0334109c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:47.353922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:47.376809 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 493/991] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:47.398549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e499062-70e1-4c5e-bb67-0c330cb7fad2 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:47.410389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:47.515582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e499062-70e1-4c5e-bb67-0c330cb7fad2 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:47.550744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2d2f7-2afd-4df9-b6d9-2f5063a37a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:47.551500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2d2f7-2afd-4df9-b6d9-2f5063a37a3c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:47.551802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2d2f7-2afd-4df9-b6d9-2f5063a37a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:47.552120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2d2f7-2afd-4df9-b6d9-2f5063a37a3c None admin] PATH_INFO: `/v3/services/image` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:47.552795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2d2f7-2afd-4df9-b6d9-2f5063a37a3c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:47.554180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2d2f7-2afd-4df9-b6d9-2f5063a37a3c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ffb2d2f7-2afd-4df9-b6d9-2f5063a37a3c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:47.566212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:47.567224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:47.572801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 499/992] 10.222.0.24 () {56 vars in 1105 bytes} [Wed May 25 15:01:47 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:47.575917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b5725-8a30-40fe-8463-c0b0334109c7 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:47.682306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b5725-8a30-40fe-8463-c0b0334109c7 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:47.718916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c2010-55bf-485c-a76f-d0b9cb431012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:47.719590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c2010-55bf-485c-a76f-d0b9cb431012 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:47.719885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c2010-55bf-485c-a76f-d0b9cb431012 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:47.720161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c2010-55bf-485c-a76f-d0b9cb431012 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:47.720879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c2010-55bf-485c-a76f-d0b9cb431012 None admin] RBAC: Adding query filter params (name=image) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:47.721186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c2010-55bf-485c-a76f-d0b9cb431012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:47.722561 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c2010-55bf-485c-a76f-d0b9cb431012 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:47.727813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 494/993] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:47.733199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2d2f7-2afd-4df9-b6d9-2f5063a37a3c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:47.802980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:47.833984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2d2f7-2afd-4df9-b6d9-2f5063a37a3c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:47.866907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbecab3-5f37-4210-aa4c-750b5b664a4d None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:47.867189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbecab3-5f37-4210-aa4c-750b5b664a4d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:47.867466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbecab3-5f37-4210-aa4c-750b5b664a4d None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:47.869090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 495/994] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:47.870004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d916c-05c7-49d0-9ab4-fbf5c090484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:47.870723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d916c-05c7-49d0-9ab4-fbf5c090484f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:47.871001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d916c-05c7-49d0-9ab4-fbf5c090484f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:47.871270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d916c-05c7-49d0-9ab4-fbf5c090484f None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:47.872008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d916c-05c7-49d0-9ab4-fbf5c090484f None admin] RBAC: Adding query filter params (type=image) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:47.872309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d916c-05c7-49d0-9ab4-fbf5c090484f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:47.873721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d916c-05c7-49d0-9ab4-fbf5c090484f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:47.874156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35c8ce-d970-424b-acdf-aa60663f856b None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:47.874435 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35c8ce-d970-424b-acdf-aa60663f856b None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:47.874708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35c8ce-d970-424b-acdf-aa60663f856b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:47.879092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 500/995] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:47.902304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-cb35c8ce-d970-424b-acdf-aa60663f856b None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:47.903543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-cb35c8ce-d970-424b-acdf-aa60663f856b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:47.955145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:47.992772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 496/996] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:48.015888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d916c-05c7-49d0-9ab4-fbf5c090484f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:48.122873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c0919-1970-4f18-a0bc-9875d88848c8 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:48.123071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c0919-1970-4f18-a0bc-9875d88848c8 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:48.123342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c0919-1970-4f18-a0bc-9875d88848c8 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:48.124871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 497/997] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:48.128700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d916c-05c7-49d0-9ab4-fbf5c090484f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:48.129613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7e7a0-e5fe-490d-b72a-86252ad86194 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:48.129904 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7e7a0-e5fe-490d-b72a-86252ad86194 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:48.130186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7e7a0-e5fe-490d-b72a-86252ad86194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:48.147079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-75c7e7a0-e5fe-490d-b72a-86252ad86194 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:48.148312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-75c7e7a0-e5fe-490d-b72a-86252ad86194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:48.165450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbb8b1-9655-4234-8680-67948a793371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:48.166635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbb8b1-9655-4234-8680-67948a793371 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:48.166921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbb8b1-9655-4234-8680-67948a793371 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:48.167507 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbb8b1-9655-4234-8680-67948a793371 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:48.168205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbb8b1-9655-4234-8680-67948a793371 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:48.170110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbb8b1-9655-4234-8680-67948a793371 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:48.173903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e7dbb8b1-9655-4234-8680-67948a793371 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:48.187445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:48.188614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:48.189457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 501/998] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:48.194809 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbb8b1-9655-4234-8680-67948a793371 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:48.221763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 498/999] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:48.246786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7e7a0-e5fe-490d-b72a-86252ad86194 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:48.304801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbb8b1-9655-4234-8680-67948a793371 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:48.340897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e1df3-c636-41aa-b3ad-c20e4a088767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:48.341684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e1df3-c636-41aa-b3ad-c20e4a088767 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:48.341971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e1df3-c636-41aa-b3ad-c20e4a088767 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:48.342527 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e1df3-c636-41aa-b3ad-c20e4a088767 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:48.343076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e1df3-c636-41aa-b3ad-c20e4a088767 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:48.343387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e1df3-c636-41aa-b3ad-c20e4a088767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:48.344898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e1df3-c636-41aa-b3ad-c20e4a088767 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:48.355103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 502/1000] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:48.355296 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7e7a0-e5fe-490d-b72a-86252ad86194 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:48.355972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e1df3-c636-41aa-b3ad-c20e4a088767 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:48.357252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:48.391019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37153be-d13c-41f6-becb-a4ba13d825c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:48.391822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37153be-d13c-41f6-becb-a4ba13d825c3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:48.392111 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37153be-d13c-41f6-becb-a4ba13d825c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:48.392395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37153be-d13c-41f6-becb-a4ba13d825c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:48.393120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37153be-d13c-41f6-becb-a4ba13d825c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:48.394557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37153be-d13c-41f6-becb-a4ba13d825c3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-c37153be-d13c-41f6-becb-a4ba13d825c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:48.406880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:48.407964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:48.408980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 499/1001] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 15:01:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:48.414538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37153be-d13c-41f6-becb-a4ba13d825c3 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:48.439098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:48.476344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e1df3-c636-41aa-b3ad-c20e4a088767 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:48.512922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c467-c272-4a35-ae6c-13a18fc8b7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:48.513828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c467-c272-4a35-ae6c-13a18fc8b7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:48.514273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c467-c272-4a35-ae6c-13a18fc8b7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:48.514554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c467-c272-4a35-ae6c-13a18fc8b7f1 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:48.515271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835c467-c272-4a35-ae6c-13a18fc8b7f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:48.515599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835c467-c272-4a35-ae6c-13a18fc8b7f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:48.517250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835c467-c272-4a35-ae6c-13a18fc8b7f1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:48.526373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37153be-d13c-41f6-becb-a4ba13d825c3 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:48.527190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 503/1002] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:48.528113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c467-c272-4a35-ae6c-13a18fc8b7f1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:48.562537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43514f43-c600-4961-9ca1-11191c0a0064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:48.563505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43514f43-c600-4961-9ca1-11191c0a0064 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:48.563797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43514f43-c600-4961-9ca1-11191c0a0064 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:48.564138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43514f43-c600-4961-9ca1-11191c0a0064 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:48.564802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43514f43-c600-4961-9ca1-11191c0a0064 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:48.565102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43514f43-c600-4961-9ca1-11191c0a0064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:48.566496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43514f43-c600-4961-9ca1-11191c0a0064 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:48.571782 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 500/1003] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 15:01:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:48.577264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43514f43-c600-4961-9ca1-11191c0a0064 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:48.611612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:48.637492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c467-c272-4a35-ae6c-13a18fc8b7f1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:48.665173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:48.677060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27ae69-5ddc-42dd-a510-c8621094771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:48.677734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27ae69-5ddc-42dd-a510-c8621094771a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:48.678025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27ae69-5ddc-42dd-a510-c8621094771a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:48.678309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27ae69-5ddc-42dd-a510-c8621094771a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:48.679117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27ae69-5ddc-42dd-a510-c8621094771a None admin] RBAC: Adding query filter params (interface=public, service_id=6029dfdb8e374d26b9ae4783f3d81471, region_id=RegionOne) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:48.679433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27ae69-5ddc-42dd-a510-c8621094771a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:48.680862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27ae69-5ddc-42dd-a510-c8621094771a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:48.690726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 504/1004] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 15:01:48 2022] GET /identity/v3/endpoints?service_id=6029dfdb8e374d26b9ae4783f3d81471&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:48.690882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43514f43-c600-4961-9ca1-11191c0a0064 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:48.691757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27ae69-5ddc-42dd-a510-c8621094771a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:48.728546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0916fa-62db-4fc3-a8cd-a616e7fab715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:48.729228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0916fa-62db-4fc3-a8cd-a616e7fab715 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:48.729516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0916fa-62db-4fc3-a8cd-a616e7fab715 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:48.729799 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0916fa-62db-4fc3-a8cd-a616e7fab715 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:48.730521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0916fa-62db-4fc3-a8cd-a616e7fab715 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:48.730833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0916fa-62db-4fc3-a8cd-a616e7fab715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:48.732643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0916fa-62db-4fc3-a8cd-a616e7fab715 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:48.743981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 501/1005] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 15:01:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:48.745374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0916fa-62db-4fc3-a8cd-a616e7fab715 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:48.791093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27ae69-5ddc-42dd-a510-c8621094771a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:48.824382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c3482-d8c1-41af-baf7-5f09b2162b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:48.825056 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c3482-d8c1-41af-baf7-5f09b2162b3c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:48.825342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c3482-d8c1-41af-baf7-5f09b2162b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:48.825617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c3482-d8c1-41af-baf7-5f09b2162b3c None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:48.826311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c3482-d8c1-41af-baf7-5f09b2162b3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:48.827718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c3482-d8c1-41af-baf7-5f09b2162b3c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:48.834456 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 505/1006] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 15:01:48 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:01:48.858335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:48.866494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0916fa-62db-4fc3-a8cd-a616e7fab715 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:48.905459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab72a6b-fcc8-47c8-817b-15226b915bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:48.906141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab72a6b-fcc8-47c8-817b-15226b915bb6 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:48.906427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab72a6b-fcc8-47c8-817b-15226b915bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:48.906703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab72a6b-fcc8-47c8-817b-15226b915bb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:48.907469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab72a6b-fcc8-47c8-817b-15226b915bb6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:48.909200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab72a6b-fcc8-47c8-817b-15226b915bb6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:48.927113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 502/1007] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 15:01:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:50.088722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf37116-d447-4f20-8e17-0d497b1a7452 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:50.089248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf37116-d447-4f20-8e17-0d497b1a7452 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:50.089652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf37116-d447-4f20-8e17-0d497b1a7452 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:50.091543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 506/1008] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:50.097066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfa236-54e8-4276-9594-fa1a9eb3e417 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:50.097527 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfa236-54e8-4276-9594-fa1a9eb3e417 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:50.097607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfa236-54e8-4276-9594-fa1a9eb3e417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:50.115044 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-3ddfa236-54e8-4276-9594-fa1a9eb3e417 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:50.116287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-3ddfa236-54e8-4276-9594-fa1a9eb3e417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:50.191266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 503/1009] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:50.213602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf37116-d447-4f20-8e17-0d497b1a7452 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:50.269404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:50.316051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf37116-d447-4f20-8e17-0d497b1a7452 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:50.350252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdbf25-a681-445f-a05f-c779fdeea449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:50.350846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdbf25-a681-445f-a05f-c779fdeea449 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:50.351103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdbf25-a681-445f-a05f-c779fdeea449 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:50.351392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdbf25-a681-445f-a05f-c779fdeea449 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:50.352160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdbf25-a681-445f-a05f-c779fdeea449 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:50.353537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdbf25-a681-445f-a05f-c779fdeea449 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:50.369204 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 507/1010] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 15:01:50 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:51.096706 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e242ee-9e8a-45b3-87eb-d9b849b35f85 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:51.097098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e242ee-9e8a-45b3-87eb-d9b849b35f85 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:51.097667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e242ee-9e8a-45b3-87eb-d9b849b35f85 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:51.098663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 504/1011] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:51.104783 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96090517-05e2-43e9-8a88-30d87b038189 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:51.105385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96090517-05e2-43e9-8a88-30d87b038189 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:51.105385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96090517-05e2-43e9-8a88-30d87b038189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:51.122466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fda1d-bd53-4f46-bca9-7471b077f2d5 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:51.122685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fda1d-bd53-4f46-bca9-7471b077f2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:51.123037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fda1d-bd53-4f46-bca9-7471b077f2d5 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:51.123459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-96090517-05e2-43e9-8a88-30d87b038189 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:51.124581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 505/1012] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:51.125236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-96090517-05e2-43e9-8a88-30d87b038189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:51.129541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f7a95-e33b-410a-9ba7-d086f5d417cc None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:51.129828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f7a95-e33b-410a-9ba7-d086f5d417cc None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:51.130130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f7a95-e33b-410a-9ba7-d086f5d417cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:51.147941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-819f7a95-e33b-410a-9ba7-d086f5d417cc None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:51.149118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-819f7a95-e33b-410a-9ba7-d086f5d417cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:51.215500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 508/1013] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:51 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:51.226657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 506/1014] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:51 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:51.240299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96090517-05e2-43e9-8a88-30d87b038189 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:51.261446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f7a95-e33b-410a-9ba7-d086f5d417cc None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:51.280602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:51.299176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:51.359844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96090517-05e2-43e9-8a88-30d87b038189 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:51.376996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f7a95-e33b-410a-9ba7-d086f5d417cc None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:51.394676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bcb9f-04a9-4a38-9e4d-132915b43d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:51.395497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bcb9f-04a9-4a38-9e4d-132915b43d79 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:51.395876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bcb9f-04a9-4a38-9e4d-132915b43d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:51.396349 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bcb9f-04a9-4a38-9e4d-132915b43d79 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:51.396899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bcb9f-04a9-4a38-9e4d-132915b43d79 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:51.398271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bcb9f-04a9-4a38-9e4d-132915b43d79 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-b98bcb9f-04a9-4a38-9e4d-132915b43d79 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:51.410889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:51.412167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:51.418637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 509/1015] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:51.419682 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bcb9f-04a9-4a38-9e4d-132915b43d79 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:51.425126 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61012d5-14f8-418e-a0b8-d2291c2ba994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:51.426052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61012d5-14f8-418e-a0b8-d2291c2ba994 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:51.426342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61012d5-14f8-418e-a0b8-d2291c2ba994 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:51.426627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61012d5-14f8-418e-a0b8-d2291c2ba994 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:51.428932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61012d5-14f8-418e-a0b8-d2291c2ba994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:51.430406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61012d5-14f8-418e-a0b8-d2291c2ba994 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:51.432396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 507/1016] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:51.440701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61012d5-14f8-418e-a0b8-d2291c2ba994 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:51.541554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:51.551425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bcb9f-04a9-4a38-9e4d-132915b43d79 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:51.561992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:51.570204 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61012d5-14f8-418e-a0b8-d2291c2ba994 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:51.597331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe343a-9754-4e5d-8a86-6f70d3285d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:51.598117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe343a-9754-4e5d-8a86-6f70d3285d03 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:51.598436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe343a-9754-4e5d-8a86-6f70d3285d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:51.598721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe343a-9754-4e5d-8a86-6f70d3285d03 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:51.599517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe343a-9754-4e5d-8a86-6f70d3285d03 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:51.599859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe343a-9754-4e5d-8a86-6f70d3285d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:51.601470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe343a-9754-4e5d-8a86-6f70d3285d03 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:51.611355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 510/1017] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:51.617663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe343a-9754-4e5d-8a86-6f70d3285d03 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:51.621382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30193e-ea9e-4afe-86ec-ea5a017de64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:51.622381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30193e-ea9e-4afe-86ec-ea5a017de64c None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:51.622381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30193e-ea9e-4afe-86ec-ea5a017de64c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:51.622591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30193e-ea9e-4afe-86ec-ea5a017de64c None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:51.623318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30193e-ea9e-4afe-86ec-ea5a017de64c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:51.624801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30193e-ea9e-4afe-86ec-ea5a017de64c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:51.653250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 508/1018] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 15:01:51 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:51.736857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe343a-9754-4e5d-8a86-6f70d3285d03 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:51.772800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d1eb3-b541-4f7b-a1d5-0c57ed72302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:51.773480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d1eb3-b541-4f7b-a1d5-0c57ed72302d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:51.773763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d1eb3-b541-4f7b-a1d5-0c57ed72302d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:51.774025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d1eb3-b541-4f7b-a1d5-0c57ed72302d None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:51.774753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d1eb3-b541-4f7b-a1d5-0c57ed72302d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:51.775063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d1eb3-b541-4f7b-a1d5-0c57ed72302d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:51.776537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d1eb3-b541-4f7b-a1d5-0c57ed72302d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:51.782477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 511/1019] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 15:01:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:51.788244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30193e-ea9e-4afe-86ec-ea5a017de64c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:51.896309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30193e-ea9e-4afe-86ec-ea5a017de64c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:51.926706 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:51.932523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54cdf8-c64a-4fb7-984b-349b84c93d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:51.933492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54cdf8-c64a-4fb7-984b-349b84c93d6a None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:51.934081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54cdf8-c64a-4fb7-984b-349b84c93d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:51.934595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54cdf8-c64a-4fb7-984b-349b84c93d6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:51.935894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54cdf8-c64a-4fb7-984b-349b84c93d6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:51.937550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54cdf8-c64a-4fb7-984b-349b84c93d6a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:51.963589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 509/1020] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 15:01:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:52.659374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4288af1-a8ff-4877-8846-6861f23b4a2e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:52.659959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4288af1-a8ff-4877-8846-6861f23b4a2e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:52.659959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4288af1-a8ff-4877-8846-6861f23b4a2e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:52.661506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 512/1021] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:52.666650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b73e1d-098f-4337-b77b-c586b0b4f2ae None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:52.667059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b73e1d-098f-4337-b77b-c586b0b4f2ae None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:52.667228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b73e1d-098f-4337-b77b-c586b0b4f2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:52.685312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-45b73e1d-098f-4337-b77b-c586b0b4f2ae None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:52.686483 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-45b73e1d-098f-4337-b77b-c586b0b4f2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:52.763980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 510/1022] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:52.786187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4288af1-a8ff-4877-8846-6861f23b4a2e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:52.825793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:52.896690 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4288af1-a8ff-4877-8846-6861f23b4a2e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:52.931707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ce059-ffe4-40c5-b797-b5e471c1c01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:52.932506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ce059-ffe4-40c5-b797-b5e471c1c01e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:52.932790 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ce059-ffe4-40c5-b797-b5e471c1c01e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:52.933072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ce059-ffe4-40c5-b797-b5e471c1c01e None admin] PATH_INFO: `/v3/services/image` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:52.933732 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ce059-ffe4-40c5-b797-b5e471c1c01e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:52.935103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ce059-ffe4-40c5-b797-b5e471c1c01e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c58ce059-ffe4-40c5-b797-b5e471c1c01e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:52.946868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:52.947896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:01:52.948741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:52.951893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 513/1023] 10.222.0.24 () {56 vars in 1105 bytes} [Wed May 25 15:01:52 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:52.954159 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b73e1d-098f-4337-b77b-c586b0b4f2ae None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:53.057305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b73e1d-098f-4337-b77b-c586b0b4f2ae None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:53.071372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:53.094108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb81329-ce65-4ccb-9d51-c1ed33cf22a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:53.094784 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81329-ce65-4ccb-9d51-c1ed33cf22a5 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:53.095067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81329-ce65-4ccb-9d51-c1ed33cf22a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:53.095345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81329-ce65-4ccb-9d51-c1ed33cf22a5 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:53.096097 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb81329-ce65-4ccb-9d51-c1ed33cf22a5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:53.096406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb81329-ce65-4ccb-9d51-c1ed33cf22a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:53.097788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb81329-ce65-4ccb-9d51-c1ed33cf22a5 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:53.107661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 511/1024] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:53.108708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ce059-ffe4-40c5-b797-b5e471c1c01e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:53.207269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:53.212122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ce059-ffe4-40c5-b797-b5e471c1c01e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:53.248123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c2dd8-b5af-499c-9251-37fa3d451ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:53.248798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c2dd8-b5af-499c-9251-37fa3d451ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:53.249085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c2dd8-b5af-499c-9251-37fa3d451ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:53.249364 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c2dd8-b5af-499c-9251-37fa3d451ef9 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:53.250082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c2dd8-b5af-499c-9251-37fa3d451ef9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:53.250389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c2dd8-b5af-499c-9251-37fa3d451ef9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:53.251777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c2dd8-b5af-499c-9251-37fa3d451ef9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:53.261662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 514/1025] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:53.262955 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb81329-ce65-4ccb-9d51-c1ed33cf22a5 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:53.365832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb81329-ce65-4ccb-9d51-c1ed33cf22a5 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:53.400064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5ea9-0208-4ab5-ac67-036cbc82282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:53.400731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5ea9-0208-4ab5-ac67-036cbc82282e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:53.401003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5ea9-0208-4ab5-ac67-036cbc82282e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:53.401277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5ea9-0208-4ab5-ac67-036cbc82282e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:53.402084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5ea9-0208-4ab5-ac67-036cbc82282e None admin] RBAC: Adding query filter params (interface=public, service_id=60746d816b1440ce9e6cb1cebd49353a, region_id=RegionOne) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:53.402395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5ea9-0208-4ab5-ac67-036cbc82282e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:53.403793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5ea9-0208-4ab5-ac67-036cbc82282e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:53.413522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 512/1026] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 15:01:53 2022] GET /identity/v3/endpoints?service_id=60746d816b1440ce9e6cb1cebd49353a&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:53.414367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c2dd8-b5af-499c-9251-37fa3d451ef9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:53.525865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c2dd8-b5af-499c-9251-37fa3d451ef9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:53.559514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7344a-1cc8-4376-a293-4b8c87301301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:53.560220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7344a-1cc8-4376-a293-4b8c87301301 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:53.560499 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7344a-1cc8-4376-a293-4b8c87301301 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:53.560773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7344a-1cc8-4376-a293-4b8c87301301 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:53.561467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7344a-1cc8-4376-a293-4b8c87301301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:53.562831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7344a-1cc8-4376-a293-4b8c87301301 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:53.569896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 515/1027] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 15:01:53 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:01:53.915601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e6114-893e-44db-84cf-5f626674137a None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:53.916170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e6114-893e-44db-84cf-5f626674137a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:53.916170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e6114-893e-44db-84cf-5f626674137a None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:53.917677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 513/1028] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:53.923330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01206a-a3f6-4248-9d27-f9b8929f6ddd None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:53.923783 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01206a-a3f6-4248-9d27-f9b8929f6ddd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:53.923956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01206a-a3f6-4248-9d27-f9b8929f6ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:53.940935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6c01206a-a3f6-4248-9d27-f9b8929f6ddd None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:53.942120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6c01206a-a3f6-4248-9d27-f9b8929f6ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:53.964187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:54.013189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 516/1029] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:54.037809 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e6114-893e-44db-84cf-5f626674137a None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:54.088994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:54.150125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e6114-893e-44db-84cf-5f626674137a None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:54.185695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4764b-66dd-4b72-8831-9d9f49470342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:54.186410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4764b-66dd-4b72-8831-9d9f49470342 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:54.186690 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4764b-66dd-4b72-8831-9d9f49470342 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:54.186964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4764b-66dd-4b72-8831-9d9f49470342 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:54.188146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4764b-66dd-4b72-8831-9d9f49470342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:54.189585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4764b-66dd-4b72-8831-9d9f49470342 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:54.195914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 514/1030] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:54.197138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01206a-a3f6-4248-9d27-f9b8929f6ddd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:54.259961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9774524-5d26-4858-9845-bda7d1ee6a97 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:54.260319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9774524-5d26-4858-9845-bda7d1ee6a97 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:54.260514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9774524-5d26-4858-9845-bda7d1ee6a97 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:54.262315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 515/1031] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:54.267047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedf8df-3c5d-4350-9bfc-6cffa69b5f8e None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:54.267336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedf8df-3c5d-4350-9bfc-6cffa69b5f8e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:54.267641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedf8df-3c5d-4350-9bfc-6cffa69b5f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:54.284882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-8bedf8df-3c5d-4350-9bfc-6cffa69b5f8e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:54.286066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-8bedf8df-3c5d-4350-9bfc-6cffa69b5f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:54.305762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01206a-a3f6-4248-9d27-f9b8929f6ddd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:54.341296 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051418b-215f-4510-9304-9b5218be6b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:54.341970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051418b-215f-4510-9304-9b5218be6b76 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:54.342249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051418b-215f-4510-9304-9b5218be6b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:54.342523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051418b-215f-4510-9304-9b5218be6b76 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:54.343243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051418b-215f-4510-9304-9b5218be6b76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:54.344696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051418b-215f-4510-9304-9b5218be6b76 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:54.358083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 516/1032] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:54.368596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 517/1033] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:01:54 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:54.385188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedf8df-3c5d-4350-9bfc-6cffa69b5f8e None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:54.436719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:54.506786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedf8df-3c5d-4350-9bfc-6cffa69b5f8e None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:54.546797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bd898-e910-450e-9655-1eed2dacfd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:54.547666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bd898-e910-450e-9655-1eed2dacfd40 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:54.547952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bd898-e910-450e-9655-1eed2dacfd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:54.548232 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bd898-e910-450e-9655-1eed2dacfd40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:54.559489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bd898-e910-450e-9655-1eed2dacfd40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-b60bd898-e910-450e-9655-1eed2dacfd40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:54.568354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:54.569707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:54.570600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 517/1034] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 15:01:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:54.577632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051418b-215f-4510-9304-9b5218be6b76 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:54.594450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:54.688844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051418b-215f-4510-9304-9b5218be6b76 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:54.726132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebba5d0-1a5d-4980-8849-141c85be60d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:54.727121 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebba5d0-1a5d-4980-8849-141c85be60d4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:54.727612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebba5d0-1a5d-4980-8849-141c85be60d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:54.728068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebba5d0-1a5d-4980-8849-141c85be60d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:54.729005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebba5d0-1a5d-4980-8849-141c85be60d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:54.729519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebba5d0-1a5d-4980-8849-141c85be60d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:54.731069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebba5d0-1a5d-4980-8849-141c85be60d4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:54.739765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 518/1035] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 15:01:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:54.745727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bd898-e910-450e-9655-1eed2dacfd40 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:54.849772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:54.853413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bd898-e910-450e-9655-1eed2dacfd40 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:54.887756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efaf9e-01d2-42c8-8e37-20fdb6666cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:54.888555 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efaf9e-01d2-42c8-8e37-20fdb6666cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:54.888821 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efaf9e-01d2-42c8-8e37-20fdb6666cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:54.889107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efaf9e-01d2-42c8-8e37-20fdb6666cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:54.899798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efaf9e-01d2-42c8-8e37-20fdb6666cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:54.901241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efaf9e-01d2-42c8-8e37-20fdb6666cc0 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-c4efaf9e-01d2-42c8-8e37-20fdb6666cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:54.918428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:54.920114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:54.921547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:54.921547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:54.921547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:54.921547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:54.923652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 518/1036] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:54.925708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebba5d0-1a5d-4980-8849-141c85be60d4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:55.003354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:55.029022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebba5d0-1a5d-4980-8849-141c85be60d4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:55.062104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b7717-d110-4b63-817d-1be8800d9cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:55.062781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7717-d110-4b63-817d-1be8800d9cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:55.063071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7717-d110-4b63-817d-1be8800d9cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:55.063356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b7717-d110-4b63-817d-1be8800d9cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:55.064115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b7717-d110-4b63-817d-1be8800d9cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:55.064431 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b7717-d110-4b63-817d-1be8800d9cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:55.065803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b7717-d110-4b63-817d-1be8800d9cb7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:55.078106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 519/1037] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:55.083585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efaf9e-01d2-42c8-8e37-20fdb6666cc0 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:55.189643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efaf9e-01d2-42c8-8e37-20fdb6666cc0 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:55.224628 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a626ac-17b5-4c76-8de8-d70985897669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:55.225493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a626ac-17b5-4c76-8de8-d70985897669 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:55.225778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a626ac-17b5-4c76-8de8-d70985897669 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:55.226057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a626ac-17b5-4c76-8de8-d70985897669 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:55.234627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a626ac-17b5-4c76-8de8-d70985897669 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:55.236218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a626ac-17b5-4c76-8de8-d70985897669 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-36a626ac-17b5-4c76-8de8-d70985897669 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:55.250898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:55.256890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:55.257916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:55.257916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:55.257916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:55.257916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:55.257916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:55.257916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:55.257916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:55.257916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:55.257916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:01:55.257916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:55.257916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 519/1038] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 15:01:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:55.258538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b7717-d110-4b63-817d-1be8800d9cb7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:55.362277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b7717-d110-4b63-817d-1be8800d9cb7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:55.397357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32ec53-209e-42a4-b9c4-bf27425fa429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:55.398033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ec53-209e-42a4-b9c4-bf27425fa429 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:55.398323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ec53-209e-42a4-b9c4-bf27425fa429 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:55.398603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ec53-209e-42a4-b9c4-bf27425fa429 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:55.399448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32ec53-209e-42a4-b9c4-bf27425fa429 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:55.399804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32ec53-209e-42a4-b9c4-bf27425fa429 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:55.401231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32ec53-209e-42a4-b9c4-bf27425fa429 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:55.402874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:55.421585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 520/1039] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 15:01:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:55.427134 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a626ac-17b5-4c76-8de8-d70985897669 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:55.442934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:55.532155 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a626ac-17b5-4c76-8de8-d70985897669 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:55.568369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6590df9-b906-4653-9a53-3ba1cb46ee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:55.569124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6590df9-b906-4653-9a53-3ba1cb46ee5c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:55.569409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6590df9-b906-4653-9a53-3ba1cb46ee5c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:55.569686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6590df9-b906-4653-9a53-3ba1cb46ee5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:55.642915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6590df9-b906-4653-9a53-3ba1cb46ee5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:55.644409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6590df9-b906-4653-9a53-3ba1cb46ee5c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:55.658586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:55.746604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 520/1040] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:01:55.752295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32ec53-209e-42a4-b9c4-bf27425fa429 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:55.776025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146442cf-bc00-45ae-8aa6-705219bd9a60 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:55.776266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146442cf-bc00-45ae-8aa6-705219bd9a60 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:55.776575 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146442cf-bc00-45ae-8aa6-705219bd9a60 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:55.777921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 521/1041] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:55.783277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644f56-6bb9-404b-af27-92cf925dbb68 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:55.783499 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644f56-6bb9-404b-af27-92cf925dbb68 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:55.783812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644f56-6bb9-404b-af27-92cf925dbb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:55.802480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-a9644f56-6bb9-404b-af27-92cf925dbb68 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:55.803835 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-a9644f56-6bb9-404b-af27-92cf925dbb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:55.856980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32ec53-209e-42a4-b9c4-bf27425fa429 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:55.872756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 522/1042] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:55.894813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740432b2-31a7-4c8d-9ec7-0c4a25504e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:55.895524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644f56-6bb9-404b-af27-92cf925dbb68 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:55.895671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740432b2-31a7-4c8d-9ec7-0c4a25504e6a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:55.895909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740432b2-31a7-4c8d-9ec7-0c4a25504e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:55.896181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740432b2-31a7-4c8d-9ec7-0c4a25504e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:55.908413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740432b2-31a7-4c8d-9ec7-0c4a25504e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:55.909883 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740432b2-31a7-4c8d-9ec7-0c4a25504e6a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-740432b2-31a7-4c8d-9ec7-0c4a25504e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:55.927952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:55.929402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:55.930315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:55.930315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:55.930315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:55.930315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:55.930315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 521/1043] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:55.934827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740432b2-31a7-4c8d-9ec7-0c4a25504e6a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:55.945971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:55.985185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:56.007252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644f56-6bb9-404b-af27-92cf925dbb68 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:56.046711 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740432b2-31a7-4c8d-9ec7-0c4a25504e6a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:56.048987 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8f76-f8f1-4c4f-be1f-461c3f18db10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:56.049797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8f76-f8f1-4c4f-be1f-461c3f18db10 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:56.050082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8f76-f8f1-4c4f-be1f-461c3f18db10 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:56.050390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8f76-f8f1-4c4f-be1f-461c3f18db10 None admin] PATH_INFO: `/v3/services/image` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:56.051046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8f76-f8f1-4c4f-be1f-461c3f18db10 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:56.052659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8f76-f8f1-4c4f-be1f-461c3f18db10 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-ae6b8f76-f8f1-4c4f-be1f-461c3f18db10 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:56.064855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:56.065928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:56.066820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 523/1044] 10.222.0.24 () {56 vars in 1105 bytes} [Wed May 25 15:01:55 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:56.072469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8f76-f8f1-4c4f-be1f-461c3f18db10 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:56.092166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383aeade-2cb3-44d5-8bcb-2085e11607c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:56.092841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383aeade-2cb3-44d5-8bcb-2085e11607c9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:56.093222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383aeade-2cb3-44d5-8bcb-2085e11607c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:56.093478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383aeade-2cb3-44d5-8bcb-2085e11607c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:56.094290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383aeade-2cb3-44d5-8bcb-2085e11607c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:56.094606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383aeade-2cb3-44d5-8bcb-2085e11607c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:56.096003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383aeade-2cb3-44d5-8bcb-2085e11607c9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:56.108081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 522/1045] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:56.113338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383aeade-2cb3-44d5-8bcb-2085e11607c9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:56.180543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8f76-f8f1-4c4f-be1f-461c3f18db10 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:56.188504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:56.220258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c8262-ecd2-46f6-a406-71c54457b593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:56.220944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c8262-ecd2-46f6-a406-71c54457b593 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:56.221233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c8262-ecd2-46f6-a406-71c54457b593 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:56.221415 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383aeade-2cb3-44d5-8bcb-2085e11607c9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:56.221520 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c8262-ecd2-46f6-a406-71c54457b593 None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:56.222227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c8262-ecd2-46f6-a406-71c54457b593 None admin] RBAC: Adding query filter params (name=image) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:56.222541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c8262-ecd2-46f6-a406-71c54457b593 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:56.223860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:56.224036 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c8262-ecd2-46f6-a406-71c54457b593 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:56.229641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 524/1046] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:56.235467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c8262-ecd2-46f6-a406-71c54457b593 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:56.262024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc89e4-810e-45f5-9c4d-359d5a7c5cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:56.262841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc89e4-810e-45f5-9c4d-359d5a7c5cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:56.263132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc89e4-810e-45f5-9c4d-359d5a7c5cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:56.263412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc89e4-810e-45f5-9c4d-359d5a7c5cb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:56.270833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc89e4-810e-45f5-9c4d-359d5a7c5cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:56.272480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc89e4-810e-45f5-9c4d-359d5a7c5cb8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-eabc89e4-810e-45f5-9c4d-359d5a7c5cb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:01:56.287523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:56.288545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:56.289591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:01:56.289591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:01:56.289591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:01:56.289591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:01:56.289591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:01:56.289591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:01:56.289591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:01:56.289591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:56.289591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 523/1047] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:01:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:56.295094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc89e4-810e-45f5-9c4d-359d5a7c5cb8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:56.338371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c8262-ecd2-46f6-a406-71c54457b593 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:56.373212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ff2f7-fcfd-4738-9823-2aa45e53705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:56.373829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ff2f7-fcfd-4738-9823-2aa45e53705c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:56.374111 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ff2f7-fcfd-4738-9823-2aa45e53705c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:56.374387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ff2f7-fcfd-4738-9823-2aa45e53705c None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:56.375111 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ff2f7-fcfd-4738-9823-2aa45e53705c None admin] RBAC: Adding query filter params (type=image) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:56.375424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ff2f7-fcfd-4738-9823-2aa45e53705c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:56.376842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ff2f7-fcfd-4738-9823-2aa45e53705c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:56.386506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 525/1048] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:56.387324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ff2f7-fcfd-4738-9823-2aa45e53705c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:56.400994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc89e4-810e-45f5-9c4d-359d5a7c5cb8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:56.426616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:56.442093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6954c-a38e-4d90-b338-228c724d82c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:56.442791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6954c-a38e-4d90-b338-228c724d82c5 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:56.443078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6954c-a38e-4d90-b338-228c724d82c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:56.443355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6954c-a38e-4d90-b338-228c724d82c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:56.444327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6954c-a38e-4d90-b338-228c724d82c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:56.444646 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6954c-a38e-4d90-b338-228c724d82c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:56.446142 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6954c-a38e-4d90-b338-228c724d82c5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:56.461739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 524/1049] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:01:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:56.468324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6954c-a38e-4d90-b338-228c724d82c5 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:56.495277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:56.510425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ff2f7-fcfd-4738-9823-2aa45e53705c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:56.548736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fca44-0e84-4bfb-9811-c5e6256ed0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:56.549402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fca44-0e84-4bfb-9811-c5e6256ed0b1 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:56.549691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fca44-0e84-4bfb-9811-c5e6256ed0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:56.549970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fca44-0e84-4bfb-9811-c5e6256ed0b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:56.550728 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fca44-0e84-4bfb-9811-c5e6256ed0b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:56.552175 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fca44-0e84-4bfb-9811-c5e6256ed0b1 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:56.571254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 526/1050] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 15:01:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:01:56.584711 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6954c-a38e-4d90-b338-228c724d82c5 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:56.633273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b6213-148f-428d-82f4-c4c1b58710cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:56.633868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b6213-148f-428d-82f4-c4c1b58710cf None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:56.634210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b6213-148f-428d-82f4-c4c1b58710cf None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:56.634498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b6213-148f-428d-82f4-c4c1b58710cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:56.635364 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b6213-148f-428d-82f4-c4c1b58710cf None admin] RBAC: Adding query filter params (role.id=b25816a24b4b4ca48ca941a6d06fe5b3, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=f553cee02ab345dabbef807bfe85544a) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:56.635722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b6213-148f-428d-82f4-c4c1b58710cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:56.637219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b6213-148f-428d-82f4-c4c1b58710cf None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:56.641063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a02f7-4503-48e8-a2e6-718333c69608 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:56.641345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a02f7-4503-48e8-a2e6-718333c69608 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:56.641632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a02f7-4503-48e8-a2e6-718333c69608 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:56.643142 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 527/1051] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:01:56.645065 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 525/1052] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:56 2022] GET /identity/v3/role_assignments?user.id=f553cee02ab345dabbef807bfe85544a&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=b25816a24b4b4ca48ca941a6d06fe5b3 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:56.649334 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2df7d-c14b-4863-8aef-1839635d1f99 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:56.649638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2df7d-c14b-4863-8aef-1839635d1f99 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:56.649951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2df7d-c14b-4863-8aef-1839635d1f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:56.669939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-fdb2df7d-c14b-4863-8aef-1839635d1f99 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:56.671196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-fdb2df7d-c14b-4863-8aef-1839635d1f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:56.754851 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 528/1053] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:01:56.778408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b6213-148f-428d-82f4-c4c1b58710cf None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:56.874925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:56.891934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b6213-148f-428d-82f4-c4c1b58710cf None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:56.926317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b004f8-fea4-4de2-a048-d27428b53ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:56.927130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b004f8-fea4-4de2-a048-d27428b53ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:56.927413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b004f8-fea4-4de2-a048-d27428b53ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:56.927718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b004f8-fea4-4de2-a048-d27428b53ea9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:56.938618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b004f8-fea4-4de2-a048-d27428b53ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-d0b004f8-fea4-4de2-a048-d27428b53ea9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:56.946332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:56.947299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:56.948655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 526/1054] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:01:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:56.953638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2df7d-c14b-4863-8aef-1839635d1f99 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:56.979437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:57.064003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2df7d-c14b-4863-8aef-1839635d1f99 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:57.098110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e15cc-1616-4637-9317-28556b56d424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:57.098784 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e15cc-1616-4637-9317-28556b56d424 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:57.099064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e15cc-1616-4637-9317-28556b56d424 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:57.099339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e15cc-1616-4637-9317-28556b56d424 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:57.100124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e15cc-1616-4637-9317-28556b56d424 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:57.100465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e15cc-1616-4637-9317-28556b56d424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:57.101844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e15cc-1616-4637-9317-28556b56d424 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:57.110712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 529/1055] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:01:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:57.116568 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b004f8-fea4-4de2-a048-d27428b53ea9 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:57.219224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b004f8-fea4-4de2-a048-d27428b53ea9 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:57.253046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299f94c-1228-4373-93fe-9cec0a30716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:57.253922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299f94c-1228-4373-93fe-9cec0a30716b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:57.254208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299f94c-1228-4373-93fe-9cec0a30716b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:57.254485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299f94c-1228-4373-93fe-9cec0a30716b None admin] PATH_INFO: `/v3/users/6e0570959ea2460fb57906480cd53019` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:57.268025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299f94c-1228-4373-93fe-9cec0a30716b None admin] RBAC: Authorizing `identity:get_user(user_id=6e0570959ea2460fb57906480cd53019)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:57.269498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299f94c-1228-4373-93fe-9cec0a30716b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:57.271370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 527/1056] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:01:57 2022] GET /identity/v3/users/6e0570959ea2460fb57906480cd53019 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:57.277363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e15cc-1616-4637-9317-28556b56d424 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:57.371159 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:57.391664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e15cc-1616-4637-9317-28556b56d424 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:57.425755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0def0-d282-4704-90f9-99a67ed498d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:57.426413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0def0-d282-4704-90f9-99a67ed498d6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:57.426694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0def0-d282-4704-90f9-99a67ed498d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:57.426973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0def0-d282-4704-90f9-99a67ed498d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:57.499810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0def0-d282-4704-90f9-99a67ed498d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:57.501184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0def0-d282-4704-90f9-99a67ed498d6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:57.579037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:57.603991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 530/1057] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:01:57.605611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299f94c-1228-4373-93fe-9cec0a30716b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:57.608850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:57.711070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299f94c-1228-4373-93fe-9cec0a30716b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:57.746992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77414dd8-365c-4936-8db2-f829d8b4f470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:57.748183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77414dd8-365c-4936-8db2-f829d8b4f470 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:57.748605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77414dd8-365c-4936-8db2-f829d8b4f470 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:57.749019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77414dd8-365c-4936-8db2-f829d8b4f470 None admin] PATH_INFO: `/v3/projects/676310f4b24b4e69a02f1c1ab22b009f` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:57.750412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77414dd8-365c-4936-8db2-f829d8b4f470 None admin] RBAC: Authorizing `identity:get_project(project_id=676310f4b24b4e69a02f1c1ab22b009f)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:57.752021 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77414dd8-365c-4936-8db2-f829d8b4f470 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:57.753984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 528/1058] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:01:57 2022] GET /identity/v3/projects/676310f4b24b4e69a02f1c1ab22b009f => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:57.760676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0def0-d282-4704-90f9-99a67ed498d6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:57.862998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0def0-d282-4704-90f9-99a67ed498d6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:57.898704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaf39a-9523-4885-af32-1a28f425b3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:57.899360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaf39a-9523-4885-af32-1a28f425b3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:57.899669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaf39a-9523-4885-af32-1a28f425b3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:57.899944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaf39a-9523-4885-af32-1a28f425b3d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:57.900890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaf39a-9523-4885-af32-1a28f425b3d2 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=676310f4b24b4e69a02f1c1ab22b009f, user.id=6e0570959ea2460fb57906480cd53019) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:57.901203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaf39a-9523-4885-af32-1a28f425b3d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:57.902636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaf39a-9523-4885-af32-1a28f425b3d2 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:57.908352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 531/1059] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:01:57 2022] GET /identity/v3/role_assignments?user.id=6e0570959ea2460fb57906480cd53019&scope.project.id=676310f4b24b4e69a02f1c1ab22b009f&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:58.805800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ea6ac-f5c5-4531-978e-af61d3ae031a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:58.806327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ea6ac-f5c5-4531-978e-af61d3ae031a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:58.806407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ea6ac-f5c5-4531-978e-af61d3ae031a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:58.807854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 529/1060] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:58.813361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbafac-fd0a-4d29-8f16-83ab850d87e2 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:58.813828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbafac-fd0a-4d29-8f16-83ab850d87e2 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:58.813905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbafac-fd0a-4d29-8f16-83ab850d87e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:58.831815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-31fbafac-fd0a-4d29-8f16-83ab850d87e2 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:58.832996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-31fbafac-fd0a-4d29-8f16-83ab850d87e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:58.849914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4439d73-bf56-4c79-abff-2545e437aaf5 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:58.850208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4439d73-bf56-4c79-abff-2545e437aaf5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:58.850514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4439d73-bf56-4c79-abff-2545e437aaf5 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:58.851972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 530/1061] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:01:58.857549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803d73c-8ab4-4154-8d71-92221a545222 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:58.857919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803d73c-8ab4-4154-8d71-92221a545222 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:58.858291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803d73c-8ab4-4154-8d71-92221a545222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:58.875589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-9803d73c-8ab4-4154-8d71-92221a545222 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:01:58.876803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-9803d73c-8ab4-4154-8d71-92221a545222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:01:58.878958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:58.909402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 532/1062] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:58.932000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbafac-fd0a-4d29-8f16-83ab850d87e2 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:58.945525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:58.951361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 531/1063] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:01:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:01:58.974084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803d73c-8ab4-4154-8d71-92221a545222 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:59.035871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbafac-fd0a-4d29-8f16-83ab850d87e2 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:59.072740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b6f4e-1a17-4c5a-ba7d-c6c65fa7fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:59.073311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6f4e-1a17-4c5a-ba7d-c6c65fa7fb22 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:59.073596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6f4e-1a17-4c5a-ba7d-c6c65fa7fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:59.073874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6f4e-1a17-4c5a-ba7d-c6c65fa7fb22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:59.080110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803d73c-8ab4-4154-8d71-92221a545222 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:59.116752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5b301-20d8-40dd-b2a9-3442596363de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:59.117563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5b301-20d8-40dd-b2a9-3442596363de None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:59.117878 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5b301-20d8-40dd-b2a9-3442596363de None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:59.118154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5b301-20d8-40dd-b2a9-3442596363de None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:59.124022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:59.129959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5b301-20d8-40dd-b2a9-3442596363de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-52a5b301-20d8-40dd-b2a9-3442596363de None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:01:59.138665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:59.139652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:59.140513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 532/1064] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 15:01:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:59.145849 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5b301-20d8-40dd-b2a9-3442596363de None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:59.154778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b6f4e-1a17-4c5a-ba7d-c6c65fa7fb22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:59.157459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b6f4e-1a17-4c5a-ba7d-c6c65fa7fb22 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:59.206934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:59.251566 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5b301-20d8-40dd-b2a9-3442596363de None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:59.267389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 533/1065] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:01:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 15:01:59.273106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b6f4e-1a17-4c5a-ba7d-c6c65fa7fb22 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:59.285624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5471a6-a367-45bc-abae-e096e928c239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:59.286299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5471a6-a367-45bc-abae-e096e928c239 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:59.286584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5471a6-a367-45bc-abae-e096e928c239 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:59.286863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5471a6-a367-45bc-abae-e096e928c239 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:59.287650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5471a6-a367-45bc-abae-e096e928c239 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:59.287965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5471a6-a367-45bc-abae-e096e928c239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:59.289454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5471a6-a367-45bc-abae-e096e928c239 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:59.297930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 533/1066] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 15:01:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:59.303342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5471a6-a367-45bc-abae-e096e928c239 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:59.351417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:59.377072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b6f4e-1a17-4c5a-ba7d-c6c65fa7fb22 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:59.408259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5471a6-a367-45bc-abae-e096e928c239 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:59.413517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b72dc-9c3f-42f6-9971-0a2d6ed2fc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:59.414320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b72dc-9c3f-42f6-9971-0a2d6ed2fc55 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:59.414601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b72dc-9c3f-42f6-9971-0a2d6ed2fc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:59.414876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b72dc-9c3f-42f6-9971-0a2d6ed2fc55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:59.425755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b72dc-9c3f-42f6-9971-0a2d6ed2fc55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:59.427198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b72dc-9c3f-42f6-9971-0a2d6ed2fc55 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:59.437723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-ee3b72dc-9c3f-42f6-9971-0a2d6ed2fc55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:59.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:59.446785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:59.447755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:59.447755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:59.447755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:59.447755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:59.452888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 534/1067] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:59.453428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b72dc-9c3f-42f6-9971-0a2d6ed2fc55 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:59.455997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de9f69-2944-4530-95f2-a062b9784dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:59.456918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9f69-2944-4530-95f2-a062b9784dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:59.457207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9f69-2944-4530-95f2-a062b9784dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:59.457541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9f69-2944-4530-95f2-a062b9784dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:59.474099 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de9f69-2944-4530-95f2-a062b9784dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:59.475634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de9f69-2944-4530-95f2-a062b9784dd6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c1de9f69-2944-4530-95f2-a062b9784dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:01:59.493179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:59.494117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:59.495672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:01:59.495672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:01:59.495672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:01:59.495672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:01:59.495672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 534/1068] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:01:59.500134 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de9f69-2944-4530-95f2-a062b9784dd6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:59.566131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b72dc-9c3f-42f6-9971-0a2d6ed2fc55 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:59.594291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:59.604434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8233894-f80f-43fb-b00c-a6143451ad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:59.605042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8233894-f80f-43fb-b00c-a6143451ad70 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:59.605166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de9f69-2944-4530-95f2-a062b9784dd6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:59.605350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8233894-f80f-43fb-b00c-a6143451ad70 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:59.605601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8233894-f80f-43fb-b00c-a6143451ad70 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:59.606341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8233894-f80f-43fb-b00c-a6143451ad70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:59.606658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8233894-f80f-43fb-b00c-a6143451ad70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:59.608081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8233894-f80f-43fb-b00c-a6143451ad70 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:59.620045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 535/1069] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:01:59.650731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e091e8-f37b-4913-8dd6-a83315a2ecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:59.651425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e091e8-f37b-4913-8dd6-a83315a2ecd1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:59.651741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e091e8-f37b-4913-8dd6-a83315a2ecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:59.652018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e091e8-f37b-4913-8dd6-a83315a2ecd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:59.652772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e091e8-f37b-4913-8dd6-a83315a2ecd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:01:59.653080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e091e8-f37b-4913-8dd6-a83315a2ecd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:59.654633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e091e8-f37b-4913-8dd6-a83315a2ecd1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:59.673203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 535/1070] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:01:59.674567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8233894-f80f-43fb-b00c-a6143451ad70 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:59.784795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8233894-f80f-43fb-b00c-a6143451ad70 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:59.821331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d6042-ba70-4010-996f-5c278c6883ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:01:59.822142 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d6042-ba70-4010-996f-5c278c6883ac None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:01:59.822424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d6042-ba70-4010-996f-5c278c6883ac None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:01:59.822699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d6042-ba70-4010-996f-5c278c6883ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:01:59.830651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d6042-ba70-4010-996f-5c278c6883ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:01:59.832148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d6042-ba70-4010-996f-5c278c6883ac None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-a87d6042-ba70-4010-996f-5c278c6883ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:01:59.846271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:01:59.847278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:01:59.848309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:01:59.848309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:01:59.848309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:01:59.848309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:01:59.848309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:01:59.848309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:01:59.848309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:01:59.848309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:01:59.848309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:01:59.848309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:01:59.848309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 536/1071] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 15:01:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:01:59.855477 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e091e8-f37b-4913-8dd6-a83315a2ecd1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:01:59.893094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:01:59.966627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e091e8-f37b-4913-8dd6-a83315a2ecd1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:01:59.999433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d7f71-7dd5-4568-8f97-3d865b158d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:00.000130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d7f71-7dd5-4568-8f97-3d865b158d49 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.000418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d7f71-7dd5-4568-8f97-3d865b158d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.000696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d7f71-7dd5-4568-8f97-3d865b158d49 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.001544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d7f71-7dd5-4568-8f97-3d865b158d49 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:00.001857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d7f71-7dd5-4568-8f97-3d865b158d49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:00.003277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d7f71-7dd5-4568-8f97-3d865b158d49 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:00.020610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 536/1072] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 15:01:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:00.026876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d6042-ba70-4010-996f-5c278c6883ac None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:00.077413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:00.096201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab9d6e-f3cd-4ef3-8790-fa618653cdd7 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.096515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab9d6e-f3cd-4ef3-8790-fa618653cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.096796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab9d6e-f3cd-4ef3-8790-fa618653cdd7 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.098185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 537/1073] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:00.103403 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c03b7b-efc6-4871-afa2-2770b2b1ea5a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.104017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c03b7b-efc6-4871-afa2-2770b2b1ea5a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.104524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c03b7b-efc6-4871-afa2-2770b2b1ea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.122957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-38c03b7b-efc6-4871-afa2-2770b2b1ea5a None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:00.124101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-38c03b7b-efc6-4871-afa2-2770b2b1ea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:00.130813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d6042-ba70-4010-996f-5c278c6883ac None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:00.164563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c13c8-8cb4-4168-97f8-2d3808f64fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:00.165361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c13c8-8cb4-4168-97f8-2d3808f64fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.165642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c13c8-8cb4-4168-97f8-2d3808f64fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.165921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c13c8-8cb4-4168-97f8-2d3808f64fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.177832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c13c8-8cb4-4168-97f8-2d3808f64fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:00.179314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c13c8-8cb4-4168-97f8-2d3808f64fb6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:00.194673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 538/1074] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-e83c13c8-8cb4-4168-97f8-2d3808f64fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:02:00.195927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:00.196938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:00.202621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:02:00.202621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:02:00.202621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:02:00.202621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:02:00.202621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 537/1075] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:00.202919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c03b7b-efc6-4871-afa2-2770b2b1ea5a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:00.216714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c13c8-8cb4-4168-97f8-2d3808f64fb6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:00.228188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:00.302624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c03b7b-efc6-4871-afa2-2770b2b1ea5a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:00.313890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:00.317292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c13c8-8cb4-4168-97f8-2d3808f64fb6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:00.335001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7471f-7123-4248-95b6-9a50d3f4c296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:00.335733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7471f-7123-4248-95b6-9a50d3f4c296 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.336017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7471f-7123-4248-95b6-9a50d3f4c296 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.336289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7471f-7123-4248-95b6-9a50d3f4c296 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.337015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7471f-7123-4248-95b6-9a50d3f4c296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:00.337322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7471f-7123-4248-95b6-9a50d3f4c296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:00.338677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7471f-7123-4248-95b6-9a50d3f4c296 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:00.349806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 539/1076] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:00.352701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d932f-af55-4e84-9811-e5116918b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:00.353502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d932f-af55-4e84-9811-e5116918b76c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.353786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d932f-af55-4e84-9811-e5116918b76c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.354062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d932f-af55-4e84-9811-e5116918b76c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.355475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7471f-7123-4248-95b6-9a50d3f4c296 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:00.364293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d932f-af55-4e84-9811-e5116918b76c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-4e0d932f-af55-4e84-9811-e5116918b76c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:00.371979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:00.373151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:02:00.374011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 538/1077] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:02:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:02:00.378988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d932f-af55-4e84-9811-e5116918b76c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:00.437642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:00.457492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7471f-7123-4248-95b6-9a50d3f4c296 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:00.478242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d932f-af55-4e84-9811-e5116918b76c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:00.490102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee338811-b520-4672-9e05-e5ee7a3c1b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:00.490977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee338811-b520-4672-9e05-e5ee7a3c1b1c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.491320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee338811-b520-4672-9e05-e5ee7a3c1b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.491645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee338811-b520-4672-9e05-e5ee7a3c1b1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.498224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee338811-b520-4672-9e05-e5ee7a3c1b1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:00.499761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee338811-b520-4672-9e05-e5ee7a3c1b1c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:00.511157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b284e82-7908-4e10-b8b6-044baf26e76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:00.511868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b284e82-7908-4e10-b8b6-044baf26e76b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.512154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b284e82-7908-4e10-b8b6-044baf26e76b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.512433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b284e82-7908-4e10-b8b6-044baf26e76b None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.513193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b284e82-7908-4e10-b8b6-044baf26e76b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:00.513507 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b284e82-7908-4e10-b8b6-044baf26e76b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ee338811-b520-4672-9e05-e5ee7a3c1b1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:02:00.514160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:00.515042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:00.516013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:02:00.516013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:02:00.516013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:02:00.516013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:02:00.516013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:02:00.516013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:02:00.516013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:02:00.516013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:02:00.516448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b284e82-7908-4e10-b8b6-044baf26e76b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:00.516518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 540/1078] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:00.521071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee338811-b520-4672-9e05-e5ee7a3c1b1c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:00.523579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 539/1079] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:02:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:00.529228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b284e82-7908-4e10-b8b6-044baf26e76b None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:00.553031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:00.619027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee338811-b520-4672-9e05-e5ee7a3c1b1c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:00.627843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b284e82-7908-4e10-b8b6-044baf26e76b None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:00.652314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719cd11-f281-48bd-9ed4-30b987a501b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:00.652966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719cd11-f281-48bd-9ed4-30b987a501b7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.653245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719cd11-f281-48bd-9ed4-30b987a501b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.653521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719cd11-f281-48bd-9ed4-30b987a501b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.654310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719cd11-f281-48bd-9ed4-30b987a501b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:00.654602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719cd11-f281-48bd-9ed4-30b987a501b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:00.656063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719cd11-f281-48bd-9ed4-30b987a501b7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:00.662121 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec821a0-dfa3-4680-a0a1-4cf6be4ca45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:00.663011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec821a0-dfa3-4680-a0a1-4cf6be4ca45a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.663293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec821a0-dfa3-4680-a0a1-4cf6be4ca45a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.663602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec821a0-dfa3-4680-a0a1-4cf6be4ca45a None admin] PATH_INFO: `/v3/users/6e0570959ea2460fb57906480cd53019` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.664842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec821a0-dfa3-4680-a0a1-4cf6be4ca45a None admin] RBAC: Authorizing `identity:get_user(user_id=6e0570959ea2460fb57906480cd53019)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:00.666266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec821a0-dfa3-4680-a0a1-4cf6be4ca45a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:00.667289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 541/1080] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:00.668069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 540/1081] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:00 2022] GET /identity/v3/users/6e0570959ea2460fb57906480cd53019 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:00.673425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec821a0-dfa3-4680-a0a1-4cf6be4ca45a None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:00.673573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719cd11-f281-48bd-9ed4-30b987a501b7 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:00.676455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:00.765407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:00.775865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719cd11-f281-48bd-9ed4-30b987a501b7 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:00.777177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec821a0-dfa3-4680-a0a1-4cf6be4ca45a None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:00.808791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d4a95-274b-4b40-901b-d3c14de4bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:00.809695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d4a95-274b-4b40-901b-d3c14de4bd24 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.810041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d4a95-274b-4b40-901b-d3c14de4bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.810350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d4a95-274b-4b40-901b-d3c14de4bd24 None admin] PATH_INFO: `/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/f553cee02ab345dabbef807bfe85544a/roles/b25816a24b4b4ca48ca941a6d06fe5b3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.812549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d4a95-274b-4b40-901b-d3c14de4bd24 None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ad2e4552f43f09ebf85b6c82a5481, user_id=f553cee02ab345dabbef807bfe85544a, role_id=b25816a24b4b4ca48ca941a6d06fe5b3)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:00.813985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d4a95-274b-4b40-901b-d3c14de4bd24 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:00.814526 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43044-2336-4913-8633-189e9019a753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:00.815405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43044-2336-4913-8633-189e9019a753 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.815723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43044-2336-4913-8633-189e9019a753 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.815975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43044-2336-4913-8633-189e9019a753 None admin] PATH_INFO: `/v3/projects/676310f4b24b4e69a02f1c1ab22b009f` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.817149 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d43044-2336-4913-8633-189e9019a753 None admin] RBAC: Authorizing `identity:get_project(project_id=676310f4b24b4e69a02f1c1ab22b009f)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:00.818760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d43044-2336-4913-8633-189e9019a753 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:00.821018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 541/1082] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:02:00 2022] GET /identity/v3/projects/676310f4b24b4e69a02f1c1ab22b009f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:00.826863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43044-2336-4913-8633-189e9019a753 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:00.828317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 542/1083] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:02:00 2022] PUT /identity/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/f553cee02ab345dabbef807bfe85544a/roles/b25816a24b4b4ca48ca941a6d06fe5b3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:00.935181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43044-2336-4913-8633-189e9019a753 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:00.972846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c19b5-ab46-4950-9536-bec559de2149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:00.973789 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c19b5-ab46-4950-9536-bec559de2149 None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:00.974072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c19b5-ab46-4950-9536-bec559de2149 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:00.974348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c19b5-ab46-4950-9536-bec559de2149 None admin] PATH_INFO: `/v3/projects/676310f4b24b4e69a02f1c1ab22b009f/users/6e0570959ea2460fb57906480cd53019/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:00.976508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c19b5-ab46-4950-9536-bec559de2149 None admin] RBAC: Authorizing `identity:create_grant(project_id=676310f4b24b4e69a02f1c1ab22b009f, user_id=6e0570959ea2460fb57906480cd53019, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:00.977975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c19b5-ab46-4950-9536-bec559de2149 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:00.992639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 542/1084] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:02:00 2022] PUT /identity/v3/projects/676310f4b24b4e69a02f1c1ab22b009f/users/6e0570959ea2460fb57906480cd53019/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:02:02.989408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39621ed-ba16-4b96-9533-14b59b0eb03b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:02.989973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39621ed-ba16-4b96-9533-14b59b0eb03b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:02.989973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39621ed-ba16-4b96-9533-14b59b0eb03b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:02.991321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 543/1085] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:02.996656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ed497-7f54-4977-b182-49c3fb074cc2 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:02.997121 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ed497-7f54-4977-b182-49c3fb074cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:02.997216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ed497-7f54-4977-b182-49c3fb074cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.015766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-ec3ed497-7f54-4977-b182-49c3fb074cc2 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:03.016971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-ec3ed497-7f54-4977-b182-49c3fb074cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:03.031388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:03.089818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 543/1086] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:03.113536 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39621ed-ba16-4b96-9533-14b59b0eb03b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:03.121753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4235844-617c-4a2e-9d69-4adf6e83a415 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:03.122041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4235844-617c-4a2e-9d69-4adf6e83a415 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:03.122322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4235844-617c-4a2e-9d69-4adf6e83a415 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.123736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 544/1087] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:03.129038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69a41d-c82e-45e6-8a2c-17a3b1db6c28 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:03.129318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69a41d-c82e-45e6-8a2c-17a3b1db6c28 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:03.129605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69a41d-c82e-45e6-8a2c-17a3b1db6c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.145691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-3c69a41d-c82e-45e6-8a2c-17a3b1db6c28 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:03.146861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-3c69a41d-c82e-45e6-8a2c-17a3b1db6c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:03.177153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:03.214111 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 545/1088] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:02:03.218054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39621ed-ba16-4b96-9533-14b59b0eb03b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:03.238214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69a41d-c82e-45e6-8a2c-17a3b1db6c28 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:03.252265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7cfd4-c13b-4d4f-ab20-addffc054d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:03.253033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7cfd4-c13b-4d4f-ab20-addffc054d84 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:03.253324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7cfd4-c13b-4d4f-ab20-addffc054d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:03.253596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7cfd4-c13b-4d4f-ab20-addffc054d84 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.265417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7cfd4-c13b-4d4f-ab20-addffc054d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-eae7cfd4-c13b-4d4f-ab20-addffc054d84 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:03.273537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:03.274678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:02:03.280610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 544/1089] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 15:02:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:03.281332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7cfd4-c13b-4d4f-ab20-addffc054d84 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:03.316116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:03.338995 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69a41d-c82e-45e6-8a2c-17a3b1db6c28 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:03.374331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d26fe-0b37-4dd8-a996-6c1cad8b6bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:03.375132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d26fe-0b37-4dd8-a996-6c1cad8b6bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:03.375417 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d26fe-0b37-4dd8-a996-6c1cad8b6bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:03.375724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d26fe-0b37-4dd8-a996-6c1cad8b6bb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.379645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7cfd4-c13b-4d4f-ab20-addffc054d84 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:03.385669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d26fe-0b37-4dd8-a996-6c1cad8b6bb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-1c8d26fe-0b37-4dd8-a996-6c1cad8b6bb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:03.393324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:03.394350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:02:03.395205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 546/1090] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:02:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:03.400762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d26fe-0b37-4dd8-a996-6c1cad8b6bb8 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:03.403755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:03.416294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff653de-7b99-4196-8f4a-f1fd7d9e7aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:03.416966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff653de-7b99-4196-8f4a-f1fd7d9e7aab None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:03.417244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff653de-7b99-4196-8f4a-f1fd7d9e7aab None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:03.417516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff653de-7b99-4196-8f4a-f1fd7d9e7aab None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.418267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff653de-7b99-4196-8f4a-f1fd7d9e7aab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:03.418572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff653de-7b99-4196-8f4a-f1fd7d9e7aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:03.420050 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff653de-7b99-4196-8f4a-f1fd7d9e7aab None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:03.428135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 545/1091] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 15:02:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:03.433992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff653de-7b99-4196-8f4a-f1fd7d9e7aab None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:03.507979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d26fe-0b37-4dd8-a996-6c1cad8b6bb8 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:03.530714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff653de-7b99-4196-8f4a-f1fd7d9e7aab None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:03.541408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f3f2a-c973-4c25-b8bc-cdd193343c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:03.542085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f3f2a-c973-4c25-b8bc-cdd193343c4d None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:03.542372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f3f2a-c973-4c25-b8bc-cdd193343c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:03.542651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f3f2a-c973-4c25-b8bc-cdd193343c4d None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.543438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f3f2a-c973-4c25-b8bc-cdd193343c4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:03.543778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f3f2a-c973-4c25-b8bc-cdd193343c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:03.545197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f3f2a-c973-4c25-b8bc-cdd193343c4d None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:03.553922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:03.559741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 547/1092] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:03.564051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f3f2a-c973-4c25-b8bc-cdd193343c4d None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:03.573983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72bdf1-53a1-46f4-b8e0-de5f3f1ad642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:03.574797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72bdf1-53a1-46f4-b8e0-de5f3f1ad642 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:03.575083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72bdf1-53a1-46f4-b8e0-de5f3f1ad642 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:03.575360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72bdf1-53a1-46f4-b8e0-de5f3f1ad642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.586413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72bdf1-53a1-46f4-b8e0-de5f3f1ad642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:03.587909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72bdf1-53a1-46f4-b8e0-de5f3f1ad642 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-6b72bdf1-53a1-46f4-b8e0-de5f3f1ad642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:02:03.604960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:03.606128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:03.607306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:02:03.607306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:02:03.607306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:02:03.607306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:02:03.607306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 546/1093] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:02:03.611803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72bdf1-53a1-46f4-b8e0-de5f3f1ad642 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:03.645914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:03.665580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f3f2a-c973-4c25-b8bc-cdd193343c4d None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:03.700489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed351962-c998-46b9-ac42-afdb112345e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:03.701370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed351962-c998-46b9-ac42-afdb112345e4 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:03.701658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed351962-c998-46b9-ac42-afdb112345e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:03.701941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed351962-c998-46b9-ac42-afdb112345e4 None admin] PATH_INFO: `/v3/users/6e0570959ea2460fb57906480cd53019` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.703258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed351962-c998-46b9-ac42-afdb112345e4 None admin] RBAC: Authorizing `identity:get_user(user_id=6e0570959ea2460fb57906480cd53019)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:03.704790 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed351962-c998-46b9-ac42-afdb112345e4 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:03.706463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 548/1094] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:03 2022] GET /identity/v3/users/6e0570959ea2460fb57906480cd53019 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:03.709303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72bdf1-53a1-46f4-b8e0-de5f3f1ad642 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:03.712142 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed351962-c998-46b9-ac42-afdb112345e4 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:03.742919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55183cc-23ce-4a9b-a7f5-904691cd7f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:03.743620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55183cc-23ce-4a9b-a7f5-904691cd7f28 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:03.743912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55183cc-23ce-4a9b-a7f5-904691cd7f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:03.744194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55183cc-23ce-4a9b-a7f5-904691cd7f28 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.744932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55183cc-23ce-4a9b-a7f5-904691cd7f28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:03.745243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55183cc-23ce-4a9b-a7f5-904691cd7f28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:03.746611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55183cc-23ce-4a9b-a7f5-904691cd7f28 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:03.762926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 547/1095] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:03.763874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55183cc-23ce-4a9b-a7f5-904691cd7f28 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:03.778277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:03.813673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed351962-c998-46b9-ac42-afdb112345e4 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:03.847573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8bc07-0746-4e51-b126-3790107c3e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:03.848236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8bc07-0746-4e51-b126-3790107c3e2b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:03.848514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8bc07-0746-4e51-b126-3790107c3e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:03.848773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8bc07-0746-4e51-b126-3790107c3e2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.857613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:03.864573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55183cc-23ce-4a9b-a7f5-904691cd7f28 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:03.898347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b552a2-4e1c-4f88-8b6a-7ca37a8b04ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:03.899213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b552a2-4e1c-4f88-8b6a-7ca37a8b04ea None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:03.899496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b552a2-4e1c-4f88-8b6a-7ca37a8b04ea None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:03.899876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b552a2-4e1c-4f88-8b6a-7ca37a8b04ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:03.907070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b552a2-4e1c-4f88-8b6a-7ca37a8b04ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:03.908554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b552a2-4e1c-4f88-8b6a-7ca37a8b04ea None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:03.913673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8bc07-0746-4e51-b126-3790107c3e2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:03.915145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8bc07-0746-4e51-b126-3790107c3e2b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c6b552a2-4e1c-4f88-8b6a-7ca37a8b04ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:02:03.923223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:03.924253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:03.925242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:03.925242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:03.925242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:02:03.925242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:02:03.925242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:02:03.925242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:02:03.925242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:02:03.925242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:02:03.925242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:02:03.925242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:02:03.925242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 548/1096] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 15:02:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:02:03.930374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b552a2-4e1c-4f88-8b6a-7ca37a8b04ea None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:03.980123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:04.014338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 549/1097] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:02:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:02:04.020141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8bc07-0746-4e51-b126-3790107c3e2b None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:04.030449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b552a2-4e1c-4f88-8b6a-7ca37a8b04ea None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:04.063005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7498e-839d-4273-a6d8-20c7d1c00c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:04.063709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7498e-839d-4273-a6d8-20c7d1c00c2b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:04.063992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7498e-839d-4273-a6d8-20c7d1c00c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:04.064269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7498e-839d-4273-a6d8-20c7d1c00c2b None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:04.065112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7498e-839d-4273-a6d8-20c7d1c00c2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:04.065423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7498e-839d-4273-a6d8-20c7d1c00c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:04.066838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7498e-839d-4273-a6d8-20c7d1c00c2b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:04.083461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 549/1098] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 15:02:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:04.089229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7498e-839d-4273-a6d8-20c7d1c00c2b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:04.104631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:04.121960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8bc07-0746-4e51-b126-3790107c3e2b None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:04.159289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b0dfd-df2a-482a-8fd0-dba19fb0dd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:04.160222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b0dfd-df2a-482a-8fd0-dba19fb0dd74 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:04.160474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b0dfd-df2a-482a-8fd0-dba19fb0dd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:04.160768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b0dfd-df2a-482a-8fd0-dba19fb0dd74 None admin] PATH_INFO: `/v3/projects/676310f4b24b4e69a02f1c1ab22b009f` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:04.162046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b0dfd-df2a-482a-8fd0-dba19fb0dd74 None admin] RBAC: Authorizing `identity:get_project(project_id=676310f4b24b4e69a02f1c1ab22b009f)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:04.163496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b0dfd-df2a-482a-8fd0-dba19fb0dd74 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:04.165230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 550/1099] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:02:04 2022] GET /identity/v3/projects/676310f4b24b4e69a02f1c1ab22b009f => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:04.171673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b0dfd-df2a-482a-8fd0-dba19fb0dd74 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:04.191177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7498e-839d-4273-a6d8-20c7d1c00c2b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:04.205370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:04.229219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f835d7-9b5c-4d9c-a8d8-ba988c703a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:04.229882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f835d7-9b5c-4d9c-a8d8-ba988c703a38 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:04.230170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f835d7-9b5c-4d9c-a8d8-ba988c703a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:04.230449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f835d7-9b5c-4d9c-a8d8-ba988c703a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:04.271282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b0dfd-df2a-482a-8fd0-dba19fb0dd74 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:04.300075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f835d7-9b5c-4d9c-a8d8-ba988c703a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:04.301512 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f835d7-9b5c-4d9c-a8d8-ba988c703a38 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:04.304781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16132a98-89aa-4dc8-a94b-a9f65969c1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:04.305459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16132a98-89aa-4dc8-a94b-a9f65969c1be None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:04.305756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16132a98-89aa-4dc8-a94b-a9f65969c1be None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:04.306041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16132a98-89aa-4dc8-a94b-a9f65969c1be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:04.306878 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16132a98-89aa-4dc8-a94b-a9f65969c1be None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=676310f4b24b4e69a02f1c1ab22b009f, user.id=6e0570959ea2460fb57906480cd53019) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:04.307184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16132a98-89aa-4dc8-a94b-a9f65969c1be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:04.308632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16132a98-89aa-4dc8-a94b-a9f65969c1be None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:04.314655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 551/1100] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:02:04 2022] GET /identity/v3/role_assignments?user.id=6e0570959ea2460fb57906480cd53019&scope.project.id=676310f4b24b4e69a02f1c1ab22b009f&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:04.315454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:04.414976 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 550/1101] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:02:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:02:04.421134 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16132a98-89aa-4dc8-a94b-a9f65969c1be None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:04.531533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:04.534728 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16132a98-89aa-4dc8-a94b-a9f65969c1be None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:04.569066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c847-b62e-40ad-b412-3408cdcfe662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:04.569872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c847-b62e-40ad-b412-3408cdcfe662 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:04.570155 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c847-b62e-40ad-b412-3408cdcfe662 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:04.570434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c847-b62e-40ad-b412-3408cdcfe662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:04.581532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196c847-b62e-40ad-b412-3408cdcfe662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:04.582997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196c847-b62e-40ad-b412-3408cdcfe662 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-9196c847-b62e-40ad-b412-3408cdcfe662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:02:04.600117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:04.601210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:04.602153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:02:04.602153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:02:04.602153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:02:04.602153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:02:04.602153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 552/1102] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:02:04.607079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f835d7-9b5c-4d9c-a8d8-ba988c703a38 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:04.706799 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f835d7-9b5c-4d9c-a8d8-ba988c703a38 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:04.721589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:04.743531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3b071-5f1d-4121-8a89-430e8115220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:04.744222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3b071-5f1d-4121-8a89-430e8115220c None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:04.744482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3b071-5f1d-4121-8a89-430e8115220c None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:04.744761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3b071-5f1d-4121-8a89-430e8115220c None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:04.745491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3b071-5f1d-4121-8a89-430e8115220c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:04.745796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3b071-5f1d-4121-8a89-430e8115220c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:04.747159 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3b071-5f1d-4121-8a89-430e8115220c None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:04.758736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 551/1103] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:04.764367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c847-b62e-40ad-b412-3408cdcfe662 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:04.869487 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c847-b62e-40ad-b412-3408cdcfe662 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:04.903783 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5733aba-3111-41ca-845d-f4fcbab99374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:04.904563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5733aba-3111-41ca-845d-f4fcbab99374 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:04.904844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5733aba-3111-41ca-845d-f4fcbab99374 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:04.905136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5733aba-3111-41ca-845d-f4fcbab99374 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:04.911777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5733aba-3111-41ca-845d-f4fcbab99374 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:04.913233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5733aba-3111-41ca-845d-f4fcbab99374 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-f5733aba-3111-41ca-845d-f4fcbab99374 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:02:04.927548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:04.928539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:04.929463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:02:04.929463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:02:04.929463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:02:04.929463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:02:04.929463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:02:04.929463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:02:04.929463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:02:04.929463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:02:04.929463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 553/1104] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:02:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:04.934840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3b071-5f1d-4121-8a89-430e8115220c None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:05.038158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3b071-5f1d-4121-8a89-430e8115220c None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:05.074314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0a07b-7e50-426f-b2cc-308a79f9f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:05.074997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0a07b-7e50-426f-b2cc-308a79f9f440 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:05.075283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0a07b-7e50-426f-b2cc-308a79f9f440 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:05.075583 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0a07b-7e50-426f-b2cc-308a79f9f440 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:05.078474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0a07b-7e50-426f-b2cc-308a79f9f440 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:05.080950 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0a07b-7e50-426f-b2cc-308a79f9f440 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:05.082406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0a07b-7e50-426f-b2cc-308a79f9f440 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:05.095942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 552/1105] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:02:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:05.102473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5733aba-3111-41ca-845d-f4fcbab99374 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:05.120425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:05.209855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5733aba-3111-41ca-845d-f4fcbab99374 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:05.243870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d98c4-e689-4916-b128-6f89843737b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:05.244524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d98c4-e689-4916-b128-6f89843737b5 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:05.244806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d98c4-e689-4916-b128-6f89843737b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:05.245085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d98c4-e689-4916-b128-6f89843737b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:05.245934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d98c4-e689-4916-b128-6f89843737b5 None admin] RBAC: Adding query filter params (role.id=b25816a24b4b4ca48ca941a6d06fe5b3, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=f553cee02ab345dabbef807bfe85544a) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:05.246244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d98c4-e689-4916-b128-6f89843737b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:05.247702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d98c4-e689-4916-b128-6f89843737b5 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:05.263596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 554/1106] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:02:05 2022] GET /identity/v3/role_assignments?user.id=f553cee02ab345dabbef807bfe85544a&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=b25816a24b4b4ca48ca941a6d06fe5b3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:06.539482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976e90a-db79-456c-b86d-4a742f61ea32 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:06.540401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976e90a-db79-456c-b86d-4a742f61ea32 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:06.540514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976e90a-db79-456c-b86d-4a742f61ea32 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:06.542726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 553/1107] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:06.548664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbcbcc-289f-497c-a33c-a0a45de149c0 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:06.549110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbcbcc-289f-497c-a33c-a0a45de149c0 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:06.549203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbcbcc-289f-497c-a33c-a0a45de149c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:06.568013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-49bbcbcc-289f-497c-a33c-a0a45de149c0 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:06.569199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-49bbcbcc-289f-497c-a33c-a0a45de149c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:06.637023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 555/1108] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:06.661970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976e90a-db79-456c-b86d-4a742f61ea32 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:06.704199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:06.773573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976e90a-db79-456c-b86d-4a742f61ea32 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:06.809305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4ad5b-e547-4c82-a935-664818bc447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:06.810091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4ad5b-e547-4c82-a935-664818bc447b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:06.810370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4ad5b-e547-4c82-a935-664818bc447b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:06.810643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4ad5b-e547-4c82-a935-664818bc447b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:06.812032 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4ad5b-e547-4c82-a935-664818bc447b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:06.813475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4ad5b-e547-4c82-a935-664818bc447b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:06.815083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 554/1109] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:02:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:06.821039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbcbcc-289f-497c-a33c-a0a45de149c0 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:06.829293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:06.920691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbcbcc-289f-497c-a33c-a0a45de149c0 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:06.956416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75250a-d851-4cc4-a1c4-b0fd62ba1b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:06.957017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75250a-d851-4cc4-a1c4-b0fd62ba1b9e None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:06.957306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75250a-d851-4cc4-a1c4-b0fd62ba1b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:06.957585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75250a-d851-4cc4-a1c4-b0fd62ba1b9e None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:06.958303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75250a-d851-4cc4-a1c4-b0fd62ba1b9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:06.959804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75250a-d851-4cc4-a1c4-b0fd62ba1b9e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:06.981595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 556/1110] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:02:06 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:02:09.198004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766366b-1c9a-4c71-90e9-f9f0e15b80a3 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:09.198864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766366b-1c9a-4c71-90e9-f9f0e15b80a3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:09.198864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766366b-1c9a-4c71-90e9-f9f0e15b80a3 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:09.201014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 555/1111] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:09.207361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80b861-cb09-4e44-b84a-67c00bd22f14 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:09.208166 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80b861-cb09-4e44-b84a-67c00bd22f14 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:09.208318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80b861-cb09-4e44-b84a-67c00bd22f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:09.227778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-ee80b861-cb09-4e44-b84a-67c00bd22f14 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:09.228978 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-ee80b861-cb09-4e44-b84a-67c00bd22f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:09.292235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:09.306052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 557/1112] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:09.342334 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766366b-1c9a-4c71-90e9-f9f0e15b80a3 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:09.468363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766366b-1c9a-4c71-90e9-f9f0e15b80a3 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:09.469884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:09.504677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659fce7-98b4-4068-bc99-ffc6ac96d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:09.505530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659fce7-98b4-4068-bc99-ffc6ac96d231 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:09.505813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659fce7-98b4-4068-bc99-ffc6ac96d231 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:09.506087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659fce7-98b4-4068-bc99-ffc6ac96d231 None admin] PATH_INFO: `/v3/roles/47a961686ccc4c6a8bb05e0f3fe5ffba` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:09.507604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659fce7-98b4-4068-bc99-ffc6ac96d231 None admin] RBAC: Authorizing `identity:get_role(role_id=47a961686ccc4c6a8bb05e0f3fe5ffba)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:09.508977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659fce7-98b4-4068-bc99-ffc6ac96d231 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:09.510362 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 556/1113] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:09 2022] GET /identity/v3/roles/47a961686ccc4c6a8bb05e0f3fe5ffba => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:09.519848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80b861-cb09-4e44-b84a-67c00bd22f14 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:09.631066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80b861-cb09-4e44-b84a-67c00bd22f14 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:09.667927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bd35d-7254-4bdb-ba9f-88b41401bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:09.668794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bd35d-7254-4bdb-ba9f-88b41401bd0e None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:09.669080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bd35d-7254-4bdb-ba9f-88b41401bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:09.669357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bd35d-7254-4bdb-ba9f-88b41401bd0e None admin] PATH_INFO: `/v3/users/59e19713e36b48cf9bb6ada4ebba657c` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:09.683601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bd35d-7254-4bdb-ba9f-88b41401bd0e None admin] RBAC: Authorizing `identity:get_user(user_id=59e19713e36b48cf9bb6ada4ebba657c)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:09.685074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bd35d-7254-4bdb-ba9f-88b41401bd0e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:09.686726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 558/1114] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:09 2022] GET /identity/v3/users/59e19713e36b48cf9bb6ada4ebba657c => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:09.695643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659fce7-98b4-4068-bc99-ffc6ac96d231 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:09.802691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659fce7-98b4-4068-bc99-ffc6ac96d231 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:09.839787 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7a6ef-73bc-43f5-9e66-a491db238dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:09.840423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7a6ef-73bc-43f5-9e66-a491db238dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:09.840708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7a6ef-73bc-43f5-9e66-a491db238dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:09.840989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7a6ef-73bc-43f5-9e66-a491db238dc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:09.879898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:09.912099 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7a6ef-73bc-43f5-9e66-a491db238dc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:09.913549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7a6ef-73bc-43f5-9e66-a491db238dc4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:10.019415 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 557/1115] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:02:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:02:10.025796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bd35d-7254-4bdb-ba9f-88b41401bd0e None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:10.084480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:10.139008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bd35d-7254-4bdb-ba9f-88b41401bd0e None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:10.174944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ba576-d870-45ae-806f-2dbebf749c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:10.175831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ba576-d870-45ae-806f-2dbebf749c10 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:10.176115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ba576-d870-45ae-806f-2dbebf749c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:10.176393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ba576-d870-45ae-806f-2dbebf749c10 None admin] PATH_INFO: `/v3/projects/676310f4b24b4e69a02f1c1ab22b009f` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:10.177587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ba576-d870-45ae-806f-2dbebf749c10 None admin] RBAC: Authorizing `identity:get_project(project_id=676310f4b24b4e69a02f1c1ab22b009f)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:10.179042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ba576-d870-45ae-806f-2dbebf749c10 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:10.180791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 559/1116] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:02:10 2022] GET /identity/v3/projects/676310f4b24b4e69a02f1c1ab22b009f => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:10.188351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7a6ef-73bc-43f5-9e66-a491db238dc4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:10.261690 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:10.297981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7a6ef-73bc-43f5-9e66-a491db238dc4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:10.338996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d27c92-23b8-485f-8934-c222256c58a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:10.339887 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d27c92-23b8-485f-8934-c222256c58a9 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:10.340274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d27c92-23b8-485f-8934-c222256c58a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:10.340642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d27c92-23b8-485f-8934-c222256c58a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:10.341939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d27c92-23b8-485f-8934-c222256c58a9 None admin] RBAC: Adding query filter params (role.id=47a961686ccc4c6a8bb05e0f3fe5ffba, scope.project.id=676310f4b24b4e69a02f1c1ab22b009f, user.id=59e19713e36b48cf9bb6ada4ebba657c) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:10.342367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d27c92-23b8-485f-8934-c222256c58a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:10.344573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d27c92-23b8-485f-8934-c222256c58a9 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:10.353762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 558/1117] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:02:10 2022] GET /identity/v3/role_assignments?user.id=59e19713e36b48cf9bb6ada4ebba657c&scope.project.id=676310f4b24b4e69a02f1c1ab22b009f&role.id=47a961686ccc4c6a8bb05e0f3fe5ffba => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:12.526551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d09619-8d95-4b33-99ec-b395529e2e01 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:12.527127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d09619-8d95-4b33-99ec-b395529e2e01 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:12.527127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d09619-8d95-4b33-99ec-b395529e2e01 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:12.528517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 560/1118] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:12.533841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bb367-0d48-4ddd-b43f-22ced1ec9b6d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:12.534289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bb367-0d48-4ddd-b43f-22ced1ec9b6d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:12.534380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bb367-0d48-4ddd-b43f-22ced1ec9b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:12.553229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-827bb367-0d48-4ddd-b43f-22ced1ec9b6d None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:12.554432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-827bb367-0d48-4ddd-b43f-22ced1ec9b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:12.624550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 559/1119] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:12.647082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d09619-8d95-4b33-99ec-b395529e2e01 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:12.755494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d09619-8d95-4b33-99ec-b395529e2e01 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:12.773949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:12.792205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2827-4f51-459b-b455-4f99725fd118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:12.793064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2827-4f51-459b-b455-4f99725fd118 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:12.793341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2827-4f51-459b-b455-4f99725fd118 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:12.793614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2827-4f51-459b-b455-4f99725fd118 None admin] PATH_INFO: `/v3/roles/47a961686ccc4c6a8bb05e0f3fe5ffba` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:12.795098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2827-4f51-459b-b455-4f99725fd118 None admin] RBAC: Authorizing `identity:get_role(role_id=47a961686ccc4c6a8bb05e0f3fe5ffba)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:12.796515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2827-4f51-459b-b455-4f99725fd118 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:12.797896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 561/1120] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:12 2022] GET /identity/v3/roles/47a961686ccc4c6a8bb05e0f3fe5ffba => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:12.804316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bb367-0d48-4ddd-b43f-22ced1ec9b6d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:12.868549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:12.914406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bb367-0d48-4ddd-b43f-22ced1ec9b6d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:12.950424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52cbf7-e48f-4a82-895a-19023fb77b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:12.951293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52cbf7-e48f-4a82-895a-19023fb77b54 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:12.951598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52cbf7-e48f-4a82-895a-19023fb77b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:12.951867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52cbf7-e48f-4a82-895a-19023fb77b54 None admin] PATH_INFO: `/v3/users/59e19713e36b48cf9bb6ada4ebba657c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:12.953099 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52cbf7-e48f-4a82-895a-19023fb77b54 None admin] RBAC: Authorizing `identity:get_user(user_id=59e19713e36b48cf9bb6ada4ebba657c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:12.954626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52cbf7-e48f-4a82-895a-19023fb77b54 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:12.956306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 560/1121] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:12 2022] GET /identity/v3/users/59e19713e36b48cf9bb6ada4ebba657c => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:12.962474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2827-4f51-459b-b455-4f99725fd118 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:13.062261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2827-4f51-459b-b455-4f99725fd118 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:13.107632 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9bde9-3b15-4a32-a603-4d5ffeb3ad4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:13.108952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9bde9-3b15-4a32-a603-4d5ffeb3ad4a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:13.109493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9bde9-3b15-4a32-a603-4d5ffeb3ad4a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:13.109988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9bde9-3b15-4a32-a603-4d5ffeb3ad4a None admin] PATH_INFO: `/v3/projects/676310f4b24b4e69a02f1c1ab22b009f` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:13.112003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9bde9-3b15-4a32-a603-4d5ffeb3ad4a None admin] RBAC: Authorizing `identity:get_project(project_id=676310f4b24b4e69a02f1c1ab22b009f)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:13.114295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9bde9-3b15-4a32-a603-4d5ffeb3ad4a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:13.116971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 562/1122] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:02:12 2022] GET /identity/v3/projects/676310f4b24b4e69a02f1c1ab22b009f => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:13.123732 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52cbf7-e48f-4a82-895a-19023fb77b54 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:13.236326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52cbf7-e48f-4a82-895a-19023fb77b54 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:13.265845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:13.271383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d904a35-82fe-47a8-9649-9489d92fa5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:13.272304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d904a35-82fe-47a8-9649-9489d92fa5a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:13.272587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d904a35-82fe-47a8-9649-9489d92fa5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:13.272863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d904a35-82fe-47a8-9649-9489d92fa5a5 None admin] PATH_INFO: `/v3/projects/676310f4b24b4e69a02f1c1ab22b009f/users/59e19713e36b48cf9bb6ada4ebba657c/roles/47a961686ccc4c6a8bb05e0f3fe5ffba` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:13.275232 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d904a35-82fe-47a8-9649-9489d92fa5a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=676310f4b24b4e69a02f1c1ab22b009f, user_id=59e19713e36b48cf9bb6ada4ebba657c, role_id=47a961686ccc4c6a8bb05e0f3fe5ffba)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:13.276719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d904a35-82fe-47a8-9649-9489d92fa5a5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:13.291939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 561/1123] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:02:13 2022] PUT /identity/v3/projects/676310f4b24b4e69a02f1c1ab22b009f/users/59e19713e36b48cf9bb6ada4ebba657c/roles/47a961686ccc4c6a8bb05e0f3fe5ffba => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:15.471308 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c66de7-4e1f-465c-abd5-8af032956350 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:15.471854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c66de7-4e1f-465c-abd5-8af032956350 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:15.471854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c66de7-4e1f-465c-abd5-8af032956350 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:15.473242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 563/1124] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:15.482063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820094-8bae-4d7f-b6c7-0ca56c9447be None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:15.482791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820094-8bae-4d7f-b6c7-0ca56c9447be None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:15.482933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820094-8bae-4d7f-b6c7-0ca56c9447be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:15.510770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-61820094-8bae-4d7f-b6c7-0ca56c9447be None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:15.511985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-61820094-8bae-4d7f-b6c7-0ca56c9447be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:15.582432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 562/1125] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:15.610989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c66de7-4e1f-465c-abd5-8af032956350 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:15.674229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:15.721512 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c66de7-4e1f-465c-abd5-8af032956350 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:15.757036 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74975e-4543-483f-8c19-7f9d68bf4cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:15.757889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74975e-4543-483f-8c19-7f9d68bf4cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:15.758171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74975e-4543-483f-8c19-7f9d68bf4cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:15.758447 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74975e-4543-483f-8c19-7f9d68bf4cf6 None admin] PATH_INFO: `/v3/roles/47a961686ccc4c6a8bb05e0f3fe5ffba` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:15.760112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74975e-4543-483f-8c19-7f9d68bf4cf6 None admin] RBAC: Authorizing `identity:get_role(role_id=47a961686ccc4c6a8bb05e0f3fe5ffba)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:15.761555 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74975e-4543-483f-8c19-7f9d68bf4cf6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:15.762922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 564/1126] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:15 2022] GET /identity/v3/roles/47a961686ccc4c6a8bb05e0f3fe5ffba => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:15.768897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820094-8bae-4d7f-b6c7-0ca56c9447be None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:15.881323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820094-8bae-4d7f-b6c7-0ca56c9447be None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:15.904569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:15.918769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654fcbb-5c78-45b2-ad5a-eeabc76a32d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:15.919681 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654fcbb-5c78-45b2-ad5a-eeabc76a32d4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:15.919967 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654fcbb-5c78-45b2-ad5a-eeabc76a32d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:15.920245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654fcbb-5c78-45b2-ad5a-eeabc76a32d4 None admin] PATH_INFO: `/v3/users/59e19713e36b48cf9bb6ada4ebba657c` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:15.921444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654fcbb-5c78-45b2-ad5a-eeabc76a32d4 None admin] RBAC: Authorizing `identity:get_user(user_id=59e19713e36b48cf9bb6ada4ebba657c)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:15.922879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654fcbb-5c78-45b2-ad5a-eeabc76a32d4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:15.924861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 563/1127] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:15 2022] GET /identity/v3/users/59e19713e36b48cf9bb6ada4ebba657c => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:15.933470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74975e-4543-483f-8c19-7f9d68bf4cf6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:16.036238 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74975e-4543-483f-8c19-7f9d68bf4cf6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:16.060193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:16.073998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22edc4-4b35-4020-8c82-02961e32b8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:16.074650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22edc4-4b35-4020-8c82-02961e32b8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:16.074937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22edc4-4b35-4020-8c82-02961e32b8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:16.075213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22edc4-4b35-4020-8c82-02961e32b8b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:16.143508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22edc4-4b35-4020-8c82-02961e32b8b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:16.144997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22edc4-4b35-4020-8c82-02961e32b8b6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:16.246069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 565/1128] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:02:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:02:16.255251 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654fcbb-5c78-45b2-ad5a-eeabc76a32d4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:16.358647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654fcbb-5c78-45b2-ad5a-eeabc76a32d4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:16.393925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b391f-d93c-4835-bab8-dcee719b5deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:16.394787 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b391f-d93c-4835-bab8-dcee719b5deb None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:16.395074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b391f-d93c-4835-bab8-dcee719b5deb None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:16.395352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b391f-d93c-4835-bab8-dcee719b5deb None admin] PATH_INFO: `/v3/projects/676310f4b24b4e69a02f1c1ab22b009f` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:16.396611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b391f-d93c-4835-bab8-dcee719b5deb None admin] RBAC: Authorizing `identity:get_project(project_id=676310f4b24b4e69a02f1c1ab22b009f)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:16.398045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b391f-d93c-4835-bab8-dcee719b5deb None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:16.399783 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 564/1129] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:02:16 2022] GET /identity/v3/projects/676310f4b24b4e69a02f1c1ab22b009f => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:16.407194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22edc4-4b35-4020-8c82-02961e32b8b6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:16.435426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:16.519258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22edc4-4b35-4020-8c82-02961e32b8b6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:16.553921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce764b4b-5737-478e-a5bb-0e49a5e1a85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:16.554579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce764b4b-5737-478e-a5bb-0e49a5e1a85f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:16.554868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce764b4b-5737-478e-a5bb-0e49a5e1a85f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:16.555153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce764b4b-5737-478e-a5bb-0e49a5e1a85f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:16.556033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce764b4b-5737-478e-a5bb-0e49a5e1a85f None admin] RBAC: Adding query filter params (role.id=47a961686ccc4c6a8bb05e0f3fe5ffba, scope.project.id=676310f4b24b4e69a02f1c1ab22b009f, user.id=59e19713e36b48cf9bb6ada4ebba657c) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:16.556352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce764b4b-5737-478e-a5bb-0e49a5e1a85f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:16.557830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce764b4b-5737-478e-a5bb-0e49a5e1a85f None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:16.563579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 566/1130] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:02:16 2022] GET /identity/v3/role_assignments?user.id=59e19713e36b48cf9bb6ada4ebba657c&scope.project.id=676310f4b24b4e69a02f1c1ab22b009f&role.id=47a961686ccc4c6a8bb05e0f3fe5ffba => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:18.760622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff7d8-dbe7-41be-a295-62f799e3814d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:18.761551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff7d8-dbe7-41be-a295-62f799e3814d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:18.761551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff7d8-dbe7-41be-a295-62f799e3814d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:18.763757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 565/1131] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:18.769227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c66ab2-b6fc-404a-b1c3-b8fb6794e563 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:18.769646 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c66ab2-b6fc-404a-b1c3-b8fb6794e563 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:18.769751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c66ab2-b6fc-404a-b1c3-b8fb6794e563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:18.788383 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-64c66ab2-b6fc-404a-b1c3-b8fb6794e563 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:18.789565 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-64c66ab2-b6fc-404a-b1c3-b8fb6794e563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:18.862971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 567/1132] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:02:18.889009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff7d8-dbe7-41be-a295-62f799e3814d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:18.954876 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:18.998385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff7d8-dbe7-41be-a295-62f799e3814d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:19.036051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23466d38-ad09-48ff-9924-6d320e747ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:19.036877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23466d38-ad09-48ff-9924-6d320e747ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:19.037164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23466d38-ad09-48ff-9924-6d320e747ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:19.037440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23466d38-ad09-48ff-9924-6d320e747ce7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:19.038662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23466d38-ad09-48ff-9924-6d320e747ce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:19.040142 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23466d38-ad09-48ff-9924-6d320e747ce7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:19.041758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 566/1133] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:02:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:19.047949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c66ab2-b6fc-404a-b1c3-b8fb6794e563 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:19.066885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:19.159978 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c66ab2-b6fc-404a-b1c3-b8fb6794e563 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:19.196890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cc1e6-e656-4e92-8319-f80776de778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:19.197544 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc1e6-e656-4e92-8319-f80776de778d None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:19.197828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc1e6-e656-4e92-8319-f80776de778d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:19.198105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc1e6-e656-4e92-8319-f80776de778d None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:19.199222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cc1e6-e656-4e92-8319-f80776de778d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:19.200928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cc1e6-e656-4e92-8319-f80776de778d None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:19.230105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 568/1134] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 15:02:19 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:21.436952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40547d57-7725-40c1-97da-c30e9a664d3c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:21.437504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40547d57-7725-40c1-97da-c30e9a664d3c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:21.437504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40547d57-7725-40c1-97da-c30e9a664d3c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:21.438899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 567/1135] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:21.445635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691ecca-1bd4-461e-8e56-6c96d3f356d2 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:21.446368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691ecca-1bd4-461e-8e56-6c96d3f356d2 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:21.446553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691ecca-1bd4-461e-8e56-6c96d3f356d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:21.470993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-b691ecca-1bd4-461e-8e56-6c96d3f356d2 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:21.472237 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-b691ecca-1bd4-461e-8e56-6c96d3f356d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:21.542871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:21.549438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 569/1136] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:21.583795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40547d57-7725-40c1-97da-c30e9a664d3c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:21.690445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40547d57-7725-40c1-97da-c30e9a664d3c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:21.722112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:21.732744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae4c4c-876c-4499-b463-ca95795508ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:21.733545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae4c4c-876c-4499-b463-ca95795508ba None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:21.733829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae4c4c-876c-4499-b463-ca95795508ba None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:21.734102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae4c4c-876c-4499-b463-ca95795508ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:21.735341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae4c4c-876c-4499-b463-ca95795508ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:21.736801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae4c4c-876c-4499-b463-ca95795508ba None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:21.738461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 568/1137] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:02:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:21.747546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691ecca-1bd4-461e-8e56-6c96d3f356d2 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:21.855002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691ecca-1bd4-461e-8e56-6c96d3f356d2 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:21.896406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd659a9d-454d-46be-a96c-092f058ced0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:21.897437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd659a9d-454d-46be-a96c-092f058ced0e None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:21.897879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd659a9d-454d-46be-a96c-092f058ced0e None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:21.898305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd659a9d-454d-46be-a96c-092f058ced0e None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:21.899452 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd659a9d-454d-46be-a96c-092f058ced0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:21.901778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd659a9d-454d-46be-a96c-092f058ced0e None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:21.929546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 570/1138] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:02:21 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:24.143621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a044e6-cac2-4285-b3c4-9b1d410b8012 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.144491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a044e6-cac2-4285-b3c4-9b1d410b8012 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.144611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a044e6-cac2-4285-b3c4-9b1d410b8012 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.146755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 569/1139] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:24.152317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8d332-eb38-4c89-8eef-67a7c26991a5 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.152733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8d332-eb38-4c89-8eef-67a7c26991a5 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.152926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8d332-eb38-4c89-8eef-67a7c26991a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.171479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-64b8d332-eb38-4c89-8eef-67a7c26991a5 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:24.172698 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-64b8d332-eb38-4c89-8eef-67a7c26991a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:24.224848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:24.245405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 571/1140] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:24.268888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a044e6-cac2-4285-b3c4-9b1d410b8012 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:24.382748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a044e6-cac2-4285-b3c4-9b1d410b8012 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:24.429308 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c558ea-ccb1-4f74-96ed-9a726ef281ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:24.430039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c558ea-ccb1-4f74-96ed-9a726ef281ce None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.430326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c558ea-ccb1-4f74-96ed-9a726ef281ce None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.430600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c558ea-ccb1-4f74-96ed-9a726ef281ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.442210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c558ea-ccb1-4f74-96ed-9a726ef281ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-82c558ea-ccb1-4f74-96ed-9a726ef281ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:24.449914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:24.450932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:02:24.452436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 570/1141] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:02:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:24.457356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8d332-eb38-4c89-8eef-67a7c26991a5 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:24.558858 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8d332-eb38-4c89-8eef-67a7c26991a5 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:24.598026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451a41f-0070-420a-acc3-8205577298da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:24.598684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451a41f-0070-420a-acc3-8205577298da None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.598974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451a41f-0070-420a-acc3-8205577298da None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.599251 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451a41f-0070-420a-acc3-8205577298da None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.600045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451a41f-0070-420a-acc3-8205577298da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:24.600352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451a41f-0070-420a-acc3-8205577298da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:24.601744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451a41f-0070-420a-acc3-8205577298da None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:24.610280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 572/1142] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:02:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:24.616257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c558ea-ccb1-4f74-96ed-9a726ef281ce None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:24.675257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:24.721600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c558ea-ccb1-4f74-96ed-9a726ef281ce None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:24.756800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4828f-0627-4b80-9da1-7d4d8e3d75dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:24.757690 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4828f-0627-4b80-9da1-7d4d8e3d75dd None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.757972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4828f-0627-4b80-9da1-7d4d8e3d75dd None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.758250 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4828f-0627-4b80-9da1-7d4d8e3d75dd None admin] PATH_INFO: `/v3/users/8e88f9b61bc84c52b960d47ecc28aa68` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.774314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4828f-0627-4b80-9da1-7d4d8e3d75dd None admin] RBAC: Authorizing `identity:get_user(user_id=8e88f9b61bc84c52b960d47ecc28aa68)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:24.775798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4828f-0627-4b80-9da1-7d4d8e3d75dd None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:24.777445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 571/1143] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:24 2022] GET /identity/v3/users/8e88f9b61bc84c52b960d47ecc28aa68 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:24.783614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451a41f-0070-420a-acc3-8205577298da None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:24.838622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:24.893940 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451a41f-0070-420a-acc3-8205577298da None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:24.928624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9806f-b7b9-44e7-9aec-da3c31566141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:24.929264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9806f-b7b9-44e7-9aec-da3c31566141 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.929548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9806f-b7b9-44e7-9aec-da3c31566141 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.929828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9806f-b7b9-44e7-9aec-da3c31566141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:25.017472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9806f-b7b9-44e7-9aec-da3c31566141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:25.018969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9806f-b7b9-44e7-9aec-da3c31566141 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:25.067323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:25.124263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 573/1144] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:02:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:02:25.130522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4828f-0627-4b80-9da1-7d4d8e3d75dd None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:25.239221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4828f-0627-4b80-9da1-7d4d8e3d75dd None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:25.252552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:25.277012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a6ff5-81dc-48c4-a64c-c78a126cc961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:25.277843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6ff5-81dc-48c4-a64c-c78a126cc961 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:25.278135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6ff5-81dc-48c4-a64c-c78a126cc961 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:25.278418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6ff5-81dc-48c4-a64c-c78a126cc961 None admin] PATH_INFO: `/v3/projects/da160c2f71134bc38c71360821897e94` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:25.279680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a6ff5-81dc-48c4-a64c-c78a126cc961 None admin] RBAC: Authorizing `identity:get_project(project_id=da160c2f71134bc38c71360821897e94)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:25.281113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a6ff5-81dc-48c4-a64c-c78a126cc961 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:25.282815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 572/1145] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:02:25 2022] GET /identity/v3/projects/da160c2f71134bc38c71360821897e94 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:25.289823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9806f-b7b9-44e7-9aec-da3c31566141 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:25.395284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9806f-b7b9-44e7-9aec-da3c31566141 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:25.430851 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27fa98-185e-490d-867c-ca43209b81d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:25.431484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27fa98-185e-490d-867c-ca43209b81d9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:25.431797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27fa98-185e-490d-867c-ca43209b81d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:25.432076 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27fa98-185e-490d-867c-ca43209b81d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:25.432904 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27fa98-185e-490d-867c-ca43209b81d9 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=da160c2f71134bc38c71360821897e94, user.id=8e88f9b61bc84c52b960d47ecc28aa68) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:25.433223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27fa98-185e-490d-867c-ca43209b81d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:25.434687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27fa98-185e-490d-867c-ca43209b81d9 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:25.440418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 574/1146] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:02:25 2022] GET /identity/v3/role_assignments?user.id=8e88f9b61bc84c52b960d47ecc28aa68&scope.project.id=da160c2f71134bc38c71360821897e94&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:27.601190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a860457-4b1a-4f6b-ba94-b357e6c08f0f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:27.601736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a860457-4b1a-4f6b-ba94-b357e6c08f0f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:27.601736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a860457-4b1a-4f6b-ba94-b357e6c08f0f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:27.603239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 573/1147] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:27.609903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0b5e4-44e3-4fc9-a5ce-aa9d0de9f729 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:27.610621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0b5e4-44e3-4fc9-a5ce-aa9d0de9f729 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:27.610775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0b5e4-44e3-4fc9-a5ce-aa9d0de9f729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:27.639591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-46b0b5e4-44e3-4fc9-a5ce-aa9d0de9f729 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:27.640827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-46b0b5e4-44e3-4fc9-a5ce-aa9d0de9f729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:27.643639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:27.711161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 575/1148] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:27.734260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a860457-4b1a-4f6b-ba94-b357e6c08f0f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:27.849658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a860457-4b1a-4f6b-ba94-b357e6c08f0f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:27.887782 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5081511-72f2-4bac-a121-34dba02ab476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:27.888606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5081511-72f2-4bac-a121-34dba02ab476 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:27.888883 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5081511-72f2-4bac-a121-34dba02ab476 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:27.889152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5081511-72f2-4bac-a121-34dba02ab476 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:27.902233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5081511-72f2-4bac-a121-34dba02ab476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c5081511-72f2-4bac-a121-34dba02ab476 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:27.909982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:27.911144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:02:27.912068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 574/1149] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:27.918127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0b5e4-44e3-4fc9-a5ce-aa9d0de9f729 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:28.018726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0b5e4-44e3-4fc9-a5ce-aa9d0de9f729 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:28.054007 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ce9b7-f97d-44f1-89f1-d6fe491702ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:28.054670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ce9b7-f97d-44f1-89f1-d6fe491702ab None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:28.054956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ce9b7-f97d-44f1-89f1-d6fe491702ab None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:28.055231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ce9b7-f97d-44f1-89f1-d6fe491702ab None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:28.056027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ce9b7-f97d-44f1-89f1-d6fe491702ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:28.056332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ce9b7-f97d-44f1-89f1-d6fe491702ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:28.057715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ce9b7-f97d-44f1-89f1-d6fe491702ab None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:28.066021 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 576/1150] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:28.073149 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5081511-72f2-4bac-a121-34dba02ab476 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:28.121802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:28.179411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5081511-72f2-4bac-a121-34dba02ab476 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:28.213985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bcbff-ab02-4e4c-a589-857ffd394dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:28.214859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bcbff-ab02-4e4c-a589-857ffd394dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:28.215137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bcbff-ab02-4e4c-a589-857ffd394dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:28.215456 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bcbff-ab02-4e4c-a589-857ffd394dc0 None admin] PATH_INFO: `/v3/users/8e88f9b61bc84c52b960d47ecc28aa68` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:28.216686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bcbff-ab02-4e4c-a589-857ffd394dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=8e88f9b61bc84c52b960d47ecc28aa68)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:28.218147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bcbff-ab02-4e4c-a589-857ffd394dc0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:28.219783 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 575/1151] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:28 2022] GET /identity/v3/users/8e88f9b61bc84c52b960d47ecc28aa68 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:28.226531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ce9b7-f97d-44f1-89f1-d6fe491702ab None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:28.231110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:28.333595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ce9b7-f97d-44f1-89f1-d6fe491702ab None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:28.371087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb98315-a39d-40fb-8493-74cc500475ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:28.372010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb98315-a39d-40fb-8493-74cc500475ab None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:28.372295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb98315-a39d-40fb-8493-74cc500475ab None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:28.372573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb98315-a39d-40fb-8493-74cc500475ab None admin] PATH_INFO: `/v3/projects/da160c2f71134bc38c71360821897e94` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:28.373856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb98315-a39d-40fb-8493-74cc500475ab None admin] RBAC: Authorizing `identity:get_project(project_id=da160c2f71134bc38c71360821897e94)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:28.375308 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb98315-a39d-40fb-8493-74cc500475ab None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:28.377059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 577/1152] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:02:28 2022] GET /identity/v3/projects/da160c2f71134bc38c71360821897e94 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:28.387485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bcbff-ab02-4e4c-a589-857ffd394dc0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:28.500275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bcbff-ab02-4e4c-a589-857ffd394dc0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:28.509298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:28.536026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1a9ac-76f9-4271-890a-c5287bfba925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:28.536909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1a9ac-76f9-4271-890a-c5287bfba925 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:28.537186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1a9ac-76f9-4271-890a-c5287bfba925 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:28.537460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1a9ac-76f9-4271-890a-c5287bfba925 None admin] PATH_INFO: `/v3/projects/da160c2f71134bc38c71360821897e94/users/8e88f9b61bc84c52b960d47ecc28aa68/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:28.539482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1a9ac-76f9-4271-890a-c5287bfba925 None admin] RBAC: Authorizing `identity:create_grant(project_id=da160c2f71134bc38c71360821897e94, user_id=8e88f9b61bc84c52b960d47ecc28aa68, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:28.540999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1a9ac-76f9-4271-890a-c5287bfba925 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:28.560741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 576/1153] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:02:28 2022] PUT /identity/v3/projects/da160c2f71134bc38c71360821897e94/users/8e88f9b61bc84c52b960d47ecc28aa68/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:30.723184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af907463-de2c-48ec-a075-5a93ad652a3a None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:30.723756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af907463-de2c-48ec-a075-5a93ad652a3a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:30.723756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af907463-de2c-48ec-a075-5a93ad652a3a None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:30.725079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 578/1154] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:30.731745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e00d-1b1a-49dc-b7dc-cc959217136f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:30.732459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e00d-1b1a-49dc-b7dc-cc959217136f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:30.732615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e00d-1b1a-49dc-b7dc-cc959217136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:30.760692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-22b9e00d-1b1a-49dc-b7dc-cc959217136f None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:30.762601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-22b9e00d-1b1a-49dc-b7dc-cc959217136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:30.836037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 577/1155] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:30.864954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af907463-de2c-48ec-a075-5a93ad652a3a None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:30.942743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:30.976164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af907463-de2c-48ec-a075-5a93ad652a3a None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:31.011577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259643e2-ee7c-4fb2-9141-9439cce8e218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:31.012403 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259643e2-ee7c-4fb2-9141-9439cce8e218 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:31.012712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259643e2-ee7c-4fb2-9141-9439cce8e218 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:31.012989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259643e2-ee7c-4fb2-9141-9439cce8e218 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:31.022642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259643e2-ee7c-4fb2-9141-9439cce8e218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-259643e2-ee7c-4fb2-9141-9439cce8e218 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:31.030247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:31.031360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:02:31.032712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 579/1156] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:31.040531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9e00d-1b1a-49dc-b7dc-cc959217136f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:31.149120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:31.153920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9e00d-1b1a-49dc-b7dc-cc959217136f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:31.207755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1ff91-0ec3-449b-a404-8cec4b54cac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:31.208418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1ff91-0ec3-449b-a404-8cec4b54cac1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:31.208698 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1ff91-0ec3-449b-a404-8cec4b54cac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:31.208971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1ff91-0ec3-449b-a404-8cec4b54cac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:31.209724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1ff91-0ec3-449b-a404-8cec4b54cac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:31.210034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1ff91-0ec3-449b-a404-8cec4b54cac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:31.211381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1ff91-0ec3-449b-a404-8cec4b54cac1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:31.223188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 578/1157] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:02:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:31.229450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259643e2-ee7c-4fb2-9141-9439cce8e218 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:31.353292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259643e2-ee7c-4fb2-9141-9439cce8e218 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:31.388535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:31.396206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a8f3f-f5cd-4d39-82fc-bdc7aef32209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:31.397093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a8f3f-f5cd-4d39-82fc-bdc7aef32209 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:31.397374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a8f3f-f5cd-4d39-82fc-bdc7aef32209 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:31.397660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a8f3f-f5cd-4d39-82fc-bdc7aef32209 None admin] PATH_INFO: `/v3/users/8e88f9b61bc84c52b960d47ecc28aa68` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:31.398930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a8f3f-f5cd-4d39-82fc-bdc7aef32209 None admin] RBAC: Authorizing `identity:get_user(user_id=8e88f9b61bc84c52b960d47ecc28aa68)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:31.400427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a8f3f-f5cd-4d39-82fc-bdc7aef32209 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:31.402118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 580/1158] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:31 2022] GET /identity/v3/users/8e88f9b61bc84c52b960d47ecc28aa68 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:31.408303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1ff91-0ec3-449b-a404-8cec4b54cac1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:31.515214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1ff91-0ec3-449b-a404-8cec4b54cac1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:31.550020 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d8aae-de4c-4538-9be1-956e98572f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:31.550641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8aae-de4c-4538-9be1-956e98572f22 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:31.550921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8aae-de4c-4538-9be1-956e98572f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:31.551213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8aae-de4c-4538-9be1-956e98572f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:31.582008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:31.626386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d8aae-de4c-4538-9be1-956e98572f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:31.627869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d8aae-de4c-4538-9be1-956e98572f22 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:31.728080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 579/1159] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:02:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:02:31.734917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a8f3f-f5cd-4d39-82fc-bdc7aef32209 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:31.840547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a8f3f-f5cd-4d39-82fc-bdc7aef32209 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:31.875387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e7d95-f0a4-4a39-83ea-8c65819f0083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:31.876263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7d95-f0a4-4a39-83ea-8c65819f0083 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:31.876550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7d95-f0a4-4a39-83ea-8c65819f0083 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:31.876821 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7d95-f0a4-4a39-83ea-8c65819f0083 None admin] PATH_INFO: `/v3/projects/da160c2f71134bc38c71360821897e94` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:31.878218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e7d95-f0a4-4a39-83ea-8c65819f0083 None admin] RBAC: Authorizing `identity:get_project(project_id=da160c2f71134bc38c71360821897e94)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:31.879683 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e7d95-f0a4-4a39-83ea-8c65819f0083 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:31.881345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 581/1160] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:02:31 2022] GET /identity/v3/projects/da160c2f71134bc38c71360821897e94 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:31.887590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d8aae-de4c-4538-9be1-956e98572f22 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:31.946338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:31.991141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d8aae-de4c-4538-9be1-956e98572f22 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:32.026917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0129602-30d3-4db3-a19e-b0edbe36e440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:32.027600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0129602-30d3-4db3-a19e-b0edbe36e440 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:32.027880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0129602-30d3-4db3-a19e-b0edbe36e440 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:32.028153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0129602-30d3-4db3-a19e-b0edbe36e440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:32.028992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0129602-30d3-4db3-a19e-b0edbe36e440 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=da160c2f71134bc38c71360821897e94, user.id=8e88f9b61bc84c52b960d47ecc28aa68) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:32.029311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0129602-30d3-4db3-a19e-b0edbe36e440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:32.030773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0129602-30d3-4db3-a19e-b0edbe36e440 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:32.036723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 580/1161] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:02:31 2022] GET /identity/v3/role_assignments?user.id=8e88f9b61bc84c52b960d47ecc28aa68&scope.project.id=da160c2f71134bc38c71360821897e94&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:34.238148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eddc1-ba52-434a-befe-7a6c6e99d27d None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.238780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eddc1-ba52-434a-befe-7a6c6e99d27d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.238780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eddc1-ba52-434a-befe-7a6c6e99d27d None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.240809 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 582/1162] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:34.247865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387b8cf-1d96-4bd0-8930-07a5e14fe4cd None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.248624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387b8cf-1d96-4bd0-8930-07a5e14fe4cd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.248763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387b8cf-1d96-4bd0-8930-07a5e14fe4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.275654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3387b8cf-1d96-4bd0-8930-07a5e14fe4cd None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:34.276862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3387b8cf-1d96-4bd0-8930-07a5e14fe4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:34.354327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 581/1163] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:02:34.378047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eddc1-ba52-434a-befe-7a6c6e99d27d None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:34.454947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:34.495629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eddc1-ba52-434a-befe-7a6c6e99d27d None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:34.530433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76eb72-ed84-4049-bd27-3849a18eb5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:34.531079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76eb72-ed84-4049-bd27-3849a18eb5af None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.531364 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76eb72-ed84-4049-bd27-3849a18eb5af None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.531666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76eb72-ed84-4049-bd27-3849a18eb5af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.599834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76eb72-ed84-4049-bd27-3849a18eb5af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:34.601283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76eb72-ed84-4049-bd27-3849a18eb5af None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:34.665421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:34.702124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 583/1164] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:02:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:02:34.711469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387b8cf-1d96-4bd0-8930-07a5e14fe4cd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:34.776515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:34.824633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387b8cf-1d96-4bd0-8930-07a5e14fe4cd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:34.862580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656943e-3750-443e-a946-59d08063a074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:34.863403 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656943e-3750-443e-a946-59d08063a074 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.863718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656943e-3750-443e-a946-59d08063a074 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.863997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656943e-3750-443e-a946-59d08063a074 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.871224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656943e-3750-443e-a946-59d08063a074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:34.872904 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656943e-3750-443e-a946-59d08063a074 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-e656943e-3750-443e-a946-59d08063a074 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:34.887057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:34.888387 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:02:34.889503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 582/1165] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 15:02:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:34.894547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76eb72-ed84-4049-bd27-3849a18eb5af None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:34.998521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76eb72-ed84-4049-bd27-3849a18eb5af None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:35.034342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f69b1-389f-4525-8d9d-71256bfa0787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:35.035000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f69b1-389f-4525-8d9d-71256bfa0787 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:35.035283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f69b1-389f-4525-8d9d-71256bfa0787 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:35.035597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f69b1-389f-4525-8d9d-71256bfa0787 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:35.036729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f69b1-389f-4525-8d9d-71256bfa0787 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:35.037253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f69b1-389f-4525-8d9d-71256bfa0787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:35.038703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f69b1-389f-4525-8d9d-71256bfa0787 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:35.045965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 584/1166] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 15:02:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:37.197069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0f95e-ecba-43ef-9bc6-b2bd34c2cba1 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:37.197959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0f95e-ecba-43ef-9bc6-b2bd34c2cba1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:37.197959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0f95e-ecba-43ef-9bc6-b2bd34c2cba1 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:37.200532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 583/1167] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:37.206889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e914af6-6d52-4acf-963e-69e48e3a18e1 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:37.207646 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e914af6-6d52-4acf-963e-69e48e3a18e1 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:37.207808 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e914af6-6d52-4acf-963e-69e48e3a18e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:37.233886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-9e914af6-6d52-4acf-963e-69e48e3a18e1 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:37.235062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-9e914af6-6d52-4acf-963e-69e48e3a18e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:37.260049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:37.315157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 585/1168] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:37.338246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0f95e-ecba-43ef-9bc6-b2bd34c2cba1 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:37.445062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0f95e-ecba-43ef-9bc6-b2bd34c2cba1 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:37.459144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:37.482009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a6951-215b-41df-88f7-75d2f3c4bb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:37.482754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a6951-215b-41df-88f7-75d2f3c4bb47 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:37.483038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a6951-215b-41df-88f7-75d2f3c4bb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:37.483318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a6951-215b-41df-88f7-75d2f3c4bb47 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:37.484110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a6951-215b-41df-88f7-75d2f3c4bb47 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:37.485486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a6951-215b-41df-88f7-75d2f3c4bb47 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:37.501233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 584/1169] 10.222.0.24 () {60 vars in 1138 bytes} [Wed May 25 15:02:37 2022] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:39.683575 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8ebe2-bc80-4435-9b3e-e5c844c855bd None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:39.684182 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8ebe2-bc80-4435-9b3e-e5c844c855bd None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:39.684182 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8ebe2-bc80-4435-9b3e-e5c844c855bd None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:39.685510 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 586/1170] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:39.691950 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcb59b-ab61-40ea-ac28-9d3ef753f276 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:39.692671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcb59b-ab61-40ea-ac28-9d3ef753f276 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:39.692833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcb59b-ab61-40ea-ac28-9d3ef753f276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:39.713759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-16dcb59b-ab61-40ea-ac28-9d3ef753f276 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:39.714902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-16dcb59b-ab61-40ea-ac28-9d3ef753f276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:39.784779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 585/1171] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:39.812595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8ebe2-bc80-4435-9b3e-e5c844c855bd None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:39.917353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8ebe2-bc80-4435-9b3e-e5c844c855bd None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:39.953213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c429f-0bd2-45b2-814a-2ddfa985496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:39.954061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c429f-0bd2-45b2-814a-2ddfa985496a None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:39.954338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c429f-0bd2-45b2-814a-2ddfa985496a None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:39.954613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c429f-0bd2-45b2-814a-2ddfa985496a None admin] PATH_INFO: `/v3/domains/026e91d604574ce9b878e2f50187f380` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:39.965151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c429f-0bd2-45b2-814a-2ddfa985496a None admin] RBAC: Authorizing `identity:get_domain(domain_id=026e91d604574ce9b878e2f50187f380)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:39.966540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c429f-0bd2-45b2-814a-2ddfa985496a None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:39.968222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 587/1172] 10.222.0.24 () {56 vars in 1183 bytes} [Wed May 25 15:02:39 2022] GET /identity/v3/domains/026e91d604574ce9b878e2f50187f380 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:39.974239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcb59b-ab61-40ea-ac28-9d3ef753f276 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:40.082128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcb59b-ab61-40ea-ac28-9d3ef753f276 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:40.084546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:40.118489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e872081-2203-4103-9b27-9fd252d4885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:40.119155 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872081-2203-4103-9b27-9fd252d4885d None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.119445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872081-2203-4103-9b27-9fd252d4885d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.119758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872081-2203-4103-9b27-9fd252d4885d None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.120479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e872081-2203-4103-9b27-9fd252d4885d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:40.121927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e872081-2203-4103-9b27-9fd252d4885d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:40.149304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 586/1173] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 15:02:39 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:42.331038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4740d-3c45-49b0-85e0-52999a06787f None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.331675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4740d-3c45-49b0-85e0-52999a06787f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.331675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4740d-3c45-49b0-85e0-52999a06787f None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.332986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 588/1174] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:42.339379 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78671-f7b0-4782-a089-e367effe888e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.340194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78671-f7b0-4782-a089-e367effe888e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.340358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78671-f7b0-4782-a089-e367effe888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.368531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-29f78671-f7b0-4782-a089-e367effe888e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:42.370437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-29f78671-f7b0-4782-a089-e367effe888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:42.445066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 587/1175] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:42.470474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4740d-3c45-49b0-85e0-52999a06787f None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.501283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.598852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4740d-3c45-49b0-85e0-52999a06787f None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.634536 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2273f8b-04e8-4b94-873a-c992ea3fb38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.635399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2273f8b-04e8-4b94-873a-c992ea3fb38b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.635721 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2273f8b-04e8-4b94-873a-c992ea3fb38b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.635999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2273f8b-04e8-4b94-873a-c992ea3fb38b None admin] PATH_INFO: `/v3/domains/026e91d604574ce9b878e2f50187f380` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.637304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2273f8b-04e8-4b94-873a-c992ea3fb38b None admin] RBAC: Authorizing `identity:get_domain(domain_id=026e91d604574ce9b878e2f50187f380)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.638766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2273f8b-04e8-4b94-873a-c992ea3fb38b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.640531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 589/1176] 10.222.0.24 () {56 vars in 1183 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/domains/026e91d604574ce9b878e2f50187f380 => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:42.646669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78671-f7b0-4782-a089-e367effe888e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.737346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.753938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78671-f7b0-4782-a089-e367effe888e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.788644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52120c1-d95b-4ca6-a198-1cd47499b897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.789315 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52120c1-d95b-4ca6-a198-1cd47499b897 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.789629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52120c1-d95b-4ca6-a198-1cd47499b897 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.789888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52120c1-d95b-4ca6-a198-1cd47499b897 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.790618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52120c1-d95b-4ca6-a198-1cd47499b897 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.792088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52120c1-d95b-4ca6-a198-1cd47499b897 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.815143 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 588/1177] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:02:42 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:02:45.055754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83515c2-be95-4dc6-b564-1ebd584328d4 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.056358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83515c2-be95-4dc6-b564-1ebd584328d4 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.056358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83515c2-be95-4dc6-b564-1ebd584328d4 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.057666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 590/1178] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:45.064116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ccab7-16db-4ba4-a974-d0f27c0badbb None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.064835 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ccab7-16db-4ba4-a974-d0f27c0badbb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.064997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ccab7-16db-4ba4-a974-d0f27c0badbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.087191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-659ccab7-16db-4ba4-a974-d0f27c0badbb None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:45.088405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-659ccab7-16db-4ba4-a974-d0f27c0badbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:45.161992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 589/1179] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:45.185437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83515c2-be95-4dc6-b564-1ebd584328d4 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.290372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:45.305382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83515c2-be95-4dc6-b564-1ebd584328d4 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.340849 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc1d7b-6ac7-4f94-8c05-cac470ee61fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.341569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc1d7b-6ac7-4f94-8c05-cac470ee61fd None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.341852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc1d7b-6ac7-4f94-8c05-cac470ee61fd None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.342128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc1d7b-6ac7-4f94-8c05-cac470ee61fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.353103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc1d7b-6ac7-4f94-8c05-cac470ee61fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-44cc1d7b-6ac7-4f94-8c05-cac470ee61fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:45.360767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:45.361949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:02:45.363039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 591/1180] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:45.368836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ccab7-16db-4ba4-a974-d0f27c0badbb None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.441257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:45.483823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ccab7-16db-4ba4-a974-d0f27c0badbb None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.518255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df514981-fa07-4109-ae52-7f37aba8f447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.518915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df514981-fa07-4109-ae52-7f37aba8f447 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.519193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df514981-fa07-4109-ae52-7f37aba8f447 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.519472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df514981-fa07-4109-ae52-7f37aba8f447 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.520279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df514981-fa07-4109-ae52-7f37aba8f447 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:45.520627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df514981-fa07-4109-ae52-7f37aba8f447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.521999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df514981-fa07-4109-ae52-7f37aba8f447 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.529964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 590/1181] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:45.536316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc1d7b-6ac7-4f94-8c05-cac470ee61fd None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.644844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc1d7b-6ac7-4f94-8c05-cac470ee61fd None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.678659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4e1f4-6bba-4a9d-9bc2-c03faf38d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.679882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4e1f4-6bba-4a9d-9bc2-c03faf38d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.680167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4e1f4-6bba-4a9d-9bc2-c03faf38d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.680445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4e1f4-6bba-4a9d-9bc2-c03faf38d9e8 None admin] PATH_INFO: `/v3/users/e77e9b5e8a284a6f8130beeb258e3cc5` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.694427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4e1f4-6bba-4a9d-9bc2-c03faf38d9e8 None admin] RBAC: Authorizing `identity:get_user(user_id=e77e9b5e8a284a6f8130beeb258e3cc5)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.696867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4e1f4-6bba-4a9d-9bc2-c03faf38d9e8 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.699726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 592/1182] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/users/e77e9b5e8a284a6f8130beeb258e3cc5 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:45.706348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df514981-fa07-4109-ae52-7f37aba8f447 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.824087 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df514981-fa07-4109-ae52-7f37aba8f447 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.859724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739abb8-10a5-4fcd-844f-2cefdbd921ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.860367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739abb8-10a5-4fcd-844f-2cefdbd921ae None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.860659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739abb8-10a5-4fcd-844f-2cefdbd921ae None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.860935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739abb8-10a5-4fcd-844f-2cefdbd921ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.863869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:45.942881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739abb8-10a5-4fcd-844f-2cefdbd921ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.944279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739abb8-10a5-4fcd-844f-2cefdbd921ae None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:46.044813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 591/1183] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:02:46.054475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4e1f4-6bba-4a9d-9bc2-c03faf38d9e8 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:46.069384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:46.170336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4e1f4-6bba-4a9d-9bc2-c03faf38d9e8 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:46.206244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8e6cd-8f0a-4713-9610-c9a24f24d65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:46.207029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8e6cd-8f0a-4713-9610-c9a24f24d65b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.207311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8e6cd-8f0a-4713-9610-c9a24f24d65b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.207603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8e6cd-8f0a-4713-9610-c9a24f24d65b None admin] PATH_INFO: `/v3/projects/6d4561da6e8e4f01967a15d56a5b37c4` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.208846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8e6cd-8f0a-4713-9610-c9a24f24d65b None admin] RBAC: Authorizing `identity:get_project(project_id=6d4561da6e8e4f01967a15d56a5b37c4)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:46.210305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8e6cd-8f0a-4713-9610-c9a24f24d65b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:46.212047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 593/1184] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:02:46 2022] GET /identity/v3/projects/6d4561da6e8e4f01967a15d56a5b37c4 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:46.220502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739abb8-10a5-4fcd-844f-2cefdbd921ae None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:46.253529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:46.329317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739abb8-10a5-4fcd-844f-2cefdbd921ae None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:46.364874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea707a08-31fe-4d69-bf7e-c15dd13e283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:46.365514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea707a08-31fe-4d69-bf7e-c15dd13e283a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.365796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea707a08-31fe-4d69-bf7e-c15dd13e283a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.366071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea707a08-31fe-4d69-bf7e-c15dd13e283a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.366905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea707a08-31fe-4d69-bf7e-c15dd13e283a None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=6d4561da6e8e4f01967a15d56a5b37c4, user.id=e77e9b5e8a284a6f8130beeb258e3cc5) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:46.367216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea707a08-31fe-4d69-bf7e-c15dd13e283a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:46.368661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea707a08-31fe-4d69-bf7e-c15dd13e283a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:46.374177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 592/1185] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:02:46 2022] GET /identity/v3/role_assignments?user.id=e77e9b5e8a284a6f8130beeb258e3cc5&scope.project.id=6d4561da6e8e4f01967a15d56a5b37c4&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:48.541548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f1f7e-d491-43bb-9092-a27345ba7576 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.542440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f1f7e-d491-43bb-9092-a27345ba7576 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.542440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f1f7e-d491-43bb-9092-a27345ba7576 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.544731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 594/1186] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:48.550265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcf344-deee-4384-8ee8-ddf3f43d0104 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.550681 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcf344-deee-4384-8ee8-ddf3f43d0104 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.550788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcf344-deee-4384-8ee8-ddf3f43d0104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.568329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-93dcf344-deee-4384-8ee8-ddf3f43d0104 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:48.569518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-93dcf344-deee-4384-8ee8-ddf3f43d0104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:48.643198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 593/1187] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:48.665942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f1f7e-d491-43bb-9092-a27345ba7576 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:48.749170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:48.778661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f1f7e-d491-43bb-9092-a27345ba7576 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:48.818857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153efd8-27fc-4bc1-a097-c931db498c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:48.819706 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153efd8-27fc-4bc1-a097-c931db498c93 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.819999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153efd8-27fc-4bc1-a097-c931db498c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.820273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153efd8-27fc-4bc1-a097-c931db498c93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.830740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153efd8-27fc-4bc1-a097-c931db498c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-b153efd8-27fc-4bc1-a097-c931db498c93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:48.838338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:48.839391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:02:48.840462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 595/1188] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:48.846674 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcf344-deee-4384-8ee8-ddf3f43d0104 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:48.877180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:48.959922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcf344-deee-4384-8ee8-ddf3f43d0104 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:48.994432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54cf8c-2886-4e0f-a6b6-388fd5d5eaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:48.995091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54cf8c-2886-4e0f-a6b6-388fd5d5eaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.995375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54cf8c-2886-4e0f-a6b6-388fd5d5eaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.995681 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54cf8c-2886-4e0f-a6b6-388fd5d5eaa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.996435 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54cf8c-2886-4e0f-a6b6-388fd5d5eaa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:48.996746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54cf8c-2886-4e0f-a6b6-388fd5d5eaa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:48.998104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54cf8c-2886-4e0f-a6b6-388fd5d5eaa3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:49.006630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 594/1189] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:49.012966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153efd8-27fc-4bc1-a097-c931db498c93 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:49.116214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153efd8-27fc-4bc1-a097-c931db498c93 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:49.152528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd68161-a18f-4ab9-8e89-85e87332fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:49.153386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd68161-a18f-4ab9-8e89-85e87332fda3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.153670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd68161-a18f-4ab9-8e89-85e87332fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.153942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd68161-a18f-4ab9-8e89-85e87332fda3 None admin] PATH_INFO: `/v3/users/e77e9b5e8a284a6f8130beeb258e3cc5` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.155245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd68161-a18f-4ab9-8e89-85e87332fda3 None admin] RBAC: Authorizing `identity:get_user(user_id=e77e9b5e8a284a6f8130beeb258e3cc5)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:49.156808 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd68161-a18f-4ab9-8e89-85e87332fda3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:49.158418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 596/1190] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:49 2022] GET /identity/v3/users/e77e9b5e8a284a6f8130beeb258e3cc5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:49.164537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54cf8c-2886-4e0f-a6b6-388fd5d5eaa3 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:49.258300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:49.270946 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54cf8c-2886-4e0f-a6b6-388fd5d5eaa3 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:49.305941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c28902-48b3-48dd-aea6-993ae973af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:49.306808 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c28902-48b3-48dd-aea6-993ae973af28 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.307090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c28902-48b3-48dd-aea6-993ae973af28 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.307365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c28902-48b3-48dd-aea6-993ae973af28 None admin] PATH_INFO: `/v3/projects/6d4561da6e8e4f01967a15d56a5b37c4` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.308598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c28902-48b3-48dd-aea6-993ae973af28 None admin] RBAC: Authorizing `identity:get_project(project_id=6d4561da6e8e4f01967a15d56a5b37c4)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:49.310031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c28902-48b3-48dd-aea6-993ae973af28 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:49.311756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 595/1191] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:02:49 2022] GET /identity/v3/projects/6d4561da6e8e4f01967a15d56a5b37c4 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:49.321199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd68161-a18f-4ab9-8e89-85e87332fda3 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:49.325811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:49.430220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd68161-a18f-4ab9-8e89-85e87332fda3 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:49.465033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e22d3-f7c8-486c-a25e-c36411ea1a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:49.465922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e22d3-f7c8-486c-a25e-c36411ea1a2b None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.466207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e22d3-f7c8-486c-a25e-c36411ea1a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.466486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e22d3-f7c8-486c-a25e-c36411ea1a2b None admin] PATH_INFO: `/v3/projects/6d4561da6e8e4f01967a15d56a5b37c4/users/e77e9b5e8a284a6f8130beeb258e3cc5/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.468583 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e22d3-f7c8-486c-a25e-c36411ea1a2b None admin] RBAC: Authorizing `identity:create_grant(project_id=6d4561da6e8e4f01967a15d56a5b37c4, user_id=e77e9b5e8a284a6f8130beeb258e3cc5, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:49.470028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e22d3-f7c8-486c-a25e-c36411ea1a2b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:49.485904 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 597/1192] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:02:49 2022] PUT /identity/v3/projects/6d4561da6e8e4f01967a15d56a5b37c4/users/e77e9b5e8a284a6f8130beeb258e3cc5/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:51.650650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dc406-87e0-46f8-bcb8-52f817595756 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.651211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dc406-87e0-46f8-bcb8-52f817595756 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.651211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dc406-87e0-46f8-bcb8-52f817595756 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.652566 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 596/1193] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:51.658085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbd9ad-db26-43d3-9170-86a77cdc1d25 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.658525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbd9ad-db26-43d3-9170-86a77cdc1d25 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.658634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbd9ad-db26-43d3-9170-86a77cdc1d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.676089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-b8dbd9ad-db26-43d3-9170-86a77cdc1d25 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:51.677302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-b8dbd9ad-db26-43d3-9170-86a77cdc1d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:51.735080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:51.746438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 598/1194] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:02:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:02:51.770408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dc406-87e0-46f8-bcb8-52f817595756 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:51.873209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dc406-87e0-46f8-bcb8-52f817595756 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:51.907110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8428b64-17f1-47d8-b04c-f88662dac6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:51.907957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8428b64-17f1-47d8-b04c-f88662dac6ca None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.908242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8428b64-17f1-47d8-b04c-f88662dac6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.908521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8428b64-17f1-47d8-b04c-f88662dac6ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.919912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8428b64-17f1-47d8-b04c-f88662dac6ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-c8428b64-17f1-47d8-b04c-f88662dac6ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:51.927516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:51.928642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:51.930019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:51.930019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:51.930019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:51.930019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:51.930019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:51.930019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:51.930019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:51.930019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:51.930019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:51.930019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:51.930019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:51.930019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:02:51.931804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 597/1195] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:02:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:51.935773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbd9ad-db26-43d3-9170-86a77cdc1d25 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:52.055385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbd9ad-db26-43d3-9170-86a77cdc1d25 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.091585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61921af9-22b4-4c38-b02b-1f9b456b9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.092271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61921af9-22b4-4c38-b02b-1f9b456b9cac None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.092564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61921af9-22b4-4c38-b02b-1f9b456b9cac None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.092843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61921af9-22b4-4c38-b02b-1f9b456b9cac None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.093637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61921af9-22b4-4c38-b02b-1f9b456b9cac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:52.093949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61921af9-22b4-4c38-b02b-1f9b456b9cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.095342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61921af9-22b4-4c38-b02b-1f9b456b9cac None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:52.103518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 599/1196] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:02:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:52.109636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8428b64-17f1-47d8-b04c-f88662dac6ca None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:52.132780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:52.221038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8428b64-17f1-47d8-b04c-f88662dac6ca None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.257472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51d5ba-2651-44a1-8005-40609a890794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.258351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51d5ba-2651-44a1-8005-40609a890794 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.258639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51d5ba-2651-44a1-8005-40609a890794 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.258916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51d5ba-2651-44a1-8005-40609a890794 None admin] PATH_INFO: `/v3/users/e77e9b5e8a284a6f8130beeb258e3cc5` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.260259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51d5ba-2651-44a1-8005-40609a890794 None admin] RBAC: Authorizing `identity:get_user(user_id=e77e9b5e8a284a6f8130beeb258e3cc5)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.261707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51d5ba-2651-44a1-8005-40609a890794 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:52.263344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 598/1197] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 15:02:52 2022] GET /identity/v3/users/e77e9b5e8a284a6f8130beeb258e3cc5 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:52.269306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61921af9-22b4-4c38-b02b-1f9b456b9cac None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:52.326173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:52.370650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61921af9-22b4-4c38-b02b-1f9b456b9cac None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.405122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1155be-a50c-412d-bd65-22fa203a68e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.405756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1155be-a50c-412d-bd65-22fa203a68e5 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.406039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1155be-a50c-412d-bd65-22fa203a68e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.406333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1155be-a50c-412d-bd65-22fa203a68e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.475673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1155be-a50c-412d-bd65-22fa203a68e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.477126 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1155be-a50c-412d-bd65-22fa203a68e5 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:52.537743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:52.584665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 600/1198] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:02:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:02:52.590781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51d5ba-2651-44a1-8005-40609a890794 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:52.695153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:52.709829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51d5ba-2651-44a1-8005-40609a890794 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.741975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab028ee-7687-4064-8160-2c22b61cca41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.742837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab028ee-7687-4064-8160-2c22b61cca41 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.743120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab028ee-7687-4064-8160-2c22b61cca41 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.743394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab028ee-7687-4064-8160-2c22b61cca41 None admin] PATH_INFO: `/v3/projects/6d4561da6e8e4f01967a15d56a5b37c4` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.744723 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab028ee-7687-4064-8160-2c22b61cca41 None admin] RBAC: Authorizing `identity:get_project(project_id=6d4561da6e8e4f01967a15d56a5b37c4)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.746160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab028ee-7687-4064-8160-2c22b61cca41 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:52.747896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 599/1199] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 15:02:52 2022] GET /identity/v3/projects/6d4561da6e8e4f01967a15d56a5b37c4 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:52.760741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1155be-a50c-412d-bd65-22fa203a68e5 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:52.886795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1155be-a50c-412d-bd65-22fa203a68e5 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.922047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b787d8-c9c5-4719-9049-572e6727ea2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.922682 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b787d8-c9c5-4719-9049-572e6727ea2f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.922960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b787d8-c9c5-4719-9049-572e6727ea2f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.923238 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b787d8-c9c5-4719-9049-572e6727ea2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.924118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b787d8-c9c5-4719-9049-572e6727ea2f None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=6d4561da6e8e4f01967a15d56a5b37c4, user.id=e77e9b5e8a284a6f8130beeb258e3cc5) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:52.924434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b787d8-c9c5-4719-9049-572e6727ea2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.925886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b787d8-c9c5-4719-9049-572e6727ea2f None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:52.932225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 601/1200] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:02:52 2022] GET /identity/v3/role_assignments?user.id=e77e9b5e8a284a6f8130beeb258e3cc5&scope.project.id=6d4561da6e8e4f01967a15d56a5b37c4&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:02.737458 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=23 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:02.929099 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=91 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:52.998823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62fdcb-2d72-4ecd-88ce-5b37ab48b319 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:52.999465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62fdcb-2d72-4ecd-88ce-5b37ab48b319 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:52.999465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62fdcb-2d72-4ecd-88ce-5b37ab48b319 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.001056 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 600/1201] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:53.006364 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a5da8-51dc-4863-aadc-61dcd8119eb7 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.007020 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a5da8-51dc-4863-aadc-61dcd8119eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.007020 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a5da8-51dc-4863-aadc-61dcd8119eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.024346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-2c8a5da8-51dc-4863-aadc-61dcd8119eb7 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:53.025542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-2c8a5da8-51dc-4863-aadc-61dcd8119eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:53.103164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 602/1202] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:03:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:03:53.128500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62fdcb-2d72-4ecd-88ce-5b37ab48b319 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:53.251469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62fdcb-2d72-4ecd-88ce-5b37ab48b319 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:53.291021 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d2cc7-419c-4830-a0f0-0bb3cca6db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:53.292041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d2cc7-419c-4830-a0f0-0bb3cca6db57 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.292337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d2cc7-419c-4830-a0f0-0bb3cca6db57 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.292726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d2cc7-419c-4830-a0f0-0bb3cca6db57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.312898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d2cc7-419c-4830-a0f0-0bb3cca6db57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:53.314756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d2cc7-419c-4830-a0f0-0bb3cca6db57 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-424d2cc7-419c-4830-a0f0-0bb3cca6db57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:53.341197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:53.342624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:53.343630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:53.343630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:53.343630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:53.343630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:03:53.343630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 601/1203] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:53.351068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a5da8-51dc-4863-aadc-61dcd8119eb7 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:53.495111 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a5da8-51dc-4863-aadc-61dcd8119eb7 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:53.529610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:53.537401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101e5a4-12df-4867-9ffc-6113751c47f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:53.538130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101e5a4-12df-4867-9ffc-6113751c47f6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.538421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101e5a4-12df-4867-9ffc-6113751c47f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.538710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101e5a4-12df-4867-9ffc-6113751c47f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.539452 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101e5a4-12df-4867-9ffc-6113751c47f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:53.539801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101e5a4-12df-4867-9ffc-6113751c47f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:53.541196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101e5a4-12df-4867-9ffc-6113751c47f6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:53.553767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 603/1204] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:53.561003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d2cc7-419c-4830-a0f0-0bb3cca6db57 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:53.645761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:53.710885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d2cc7-419c-4830-a0f0-0bb3cca6db57 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:53.747998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c573f4-5c41-4b52-b20f-1fb42185e5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:53.748720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c573f4-5c41-4b52-b20f-1fb42185e5a5 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.749107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c573f4-5c41-4b52-b20f-1fb42185e5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.749378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c573f4-5c41-4b52-b20f-1fb42185e5a5 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.750095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c573f4-5c41-4b52-b20f-1fb42185e5a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:53.751538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c573f4-5c41-4b52-b20f-1fb42185e5a5 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:53.783402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 602/1205] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 15:03:53 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:56.410228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389ef25-d088-4bc7-b2b6-05d07be7b384 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.410898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389ef25-d088-4bc7-b2b6-05d07be7b384 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.410898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389ef25-d088-4bc7-b2b6-05d07be7b384 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.415678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 604/1206] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:56.418470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0872-3772-4bb4-a4f7-43b5268aa326 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.418921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0872-3772-4bb4-a4f7-43b5268aa326 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.419228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0872-3772-4bb4-a4f7-43b5268aa326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.444337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c01c0872-3772-4bb4-a4f7-43b5268aa326 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:56.445798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c01c0872-3772-4bb4-a4f7-43b5268aa326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:56.525809 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 603/1207] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:03:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:03:56.551981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389ef25-d088-4bc7-b2b6-05d07be7b384 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:56.685233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389ef25-d088-4bc7-b2b6-05d07be7b384 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:56.723239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc7eb0-d88f-481c-9faa-03759d6d105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:56.724179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc7eb0-d88f-481c-9faa-03759d6d105f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.724503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc7eb0-d88f-481c-9faa-03759d6d105f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.724813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc7eb0-d88f-481c-9faa-03759d6d105f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.735909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc7eb0-d88f-481c-9faa-03759d6d105f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-93cc7eb0-d88f-481c-9faa-03759d6d105f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:56.745186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:56.746500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:03:56.747396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 605/1208] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:03:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:56.753615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c0872-3772-4bb4-a4f7-43b5268aa326 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:56.800620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:56.873516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c0872-3772-4bb4-a4f7-43b5268aa326 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:56.914912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67163ed-1e60-4408-bd72-18986934c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:56.915763 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67163ed-1e60-4408-bd72-18986934c617 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:56.916052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67163ed-1e60-4408-bd72-18986934c617 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:56.916372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67163ed-1e60-4408-bd72-18986934c617 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:56.917317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67163ed-1e60-4408-bd72-18986934c617 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:56.917698 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67163ed-1e60-4408-bd72-18986934c617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:56.919611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67163ed-1e60-4408-bd72-18986934c617 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:56.931902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 604/1209] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:03:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:56.938805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc7eb0-d88f-481c-9faa-03759d6d105f None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:56.997960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:57.067449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc7eb0-d88f-481c-9faa-03759d6d105f None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:57.109764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6345008-74a6-429b-9a8d-d28641bba58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:57.110675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6345008-74a6-429b-9a8d-d28641bba58d None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:57.110994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6345008-74a6-429b-9a8d-d28641bba58d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:57.111271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6345008-74a6-429b-9a8d-d28641bba58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:57.123279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6345008-74a6-429b-9a8d-d28641bba58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:57.124809 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6345008-74a6-429b-9a8d-d28641bba58d None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-a6345008-74a6-429b-9a8d-d28641bba58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:57.144813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:57.145993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:57.147044 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:57.147044 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:57.147044 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:57.147044 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:03:57.147044 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 606/1210] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:57.152806 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67163ed-1e60-4408-bd72-18986934c617 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:57.288352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:57.292952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67163ed-1e60-4408-bd72-18986934c617 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:57.335930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db26f58-18b5-49a8-925e-8e51e0ea3de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:57.336602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db26f58-18b5-49a8-925e-8e51e0ea3de4 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:57.336894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db26f58-18b5-49a8-925e-8e51e0ea3de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:57.337148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db26f58-18b5-49a8-925e-8e51e0ea3de4 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:57.337881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db26f58-18b5-49a8-925e-8e51e0ea3de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:57.338186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db26f58-18b5-49a8-925e-8e51e0ea3de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:57.339538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db26f58-18b5-49a8-925e-8e51e0ea3de4 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:57.358604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 605/1211] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:57.360920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6345008-74a6-429b-9a8d-d28641bba58d None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:57.472031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6345008-74a6-429b-9a8d-d28641bba58d None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:57.474759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:57.509365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc611dae-7a04-4f37-967f-17db3d86d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:57.510922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc611dae-7a04-4f37-967f-17db3d86d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:57.510922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc611dae-7a04-4f37-967f-17db3d86d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:57.510922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc611dae-7a04-4f37-967f-17db3d86d3c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:57.519271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc611dae-7a04-4f37-967f-17db3d86d3c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:57.521051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc611dae-7a04-4f37-967f-17db3d86d3c1 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-dc611dae-7a04-4f37-967f-17db3d86d3c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:57.536736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:57.537956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:57.539211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:57.539211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:57.539211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:57.539211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:57.539211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:57.539211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:57.539211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:57.539211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:57.539211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:03:57.539211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:03:57.544734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 607/1212] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:03:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:57.546789 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db26f58-18b5-49a8-925e-8e51e0ea3de4 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:57.656568 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db26f58-18b5-49a8-925e-8e51e0ea3de4 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:57.698062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f2e25-58e8-462c-b610-a1e5ca683c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:57.698744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f2e25-58e8-462c-b610-a1e5ca683c06 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:57.699084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f2e25-58e8-462c-b610-a1e5ca683c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:57.699366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f2e25-58e8-462c-b610-a1e5ca683c06 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:57.700336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f2e25-58e8-462c-b610-a1e5ca683c06 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:57.701492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f2e25-58e8-462c-b610-a1e5ca683c06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:57.702196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f2e25-58e8-462c-b610-a1e5ca683c06 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:57.725275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 606/1213] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 15:03:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:57.726952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc611dae-7a04-4f37-967f-17db3d86d3c1 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:57.850101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc611dae-7a04-4f37-967f-17db3d86d3c1 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:57.889909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe16b55-a548-426c-bc9e-016f09559087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:57.890797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe16b55-a548-426c-bc9e-016f09559087 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:57.891223 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe16b55-a548-426c-bc9e-016f09559087 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:57.891479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe16b55-a548-426c-bc9e-016f09559087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:57.927322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:57.976276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe16b55-a548-426c-bc9e-016f09559087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:57.977756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe16b55-a548-426c-bc9e-016f09559087 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.107062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 608/1214] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:03:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:03:58.108022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f2e25-58e8-462c-b610-a1e5ca683c06 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.130519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:58.236602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f2e25-58e8-462c-b610-a1e5ca683c06 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.291116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d6cee-a4b8-4d1e-932b-8b187f6ed95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.292446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6cee-a4b8-4d1e-932b-8b187f6ed95a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.292740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6cee-a4b8-4d1e-932b-8b187f6ed95a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.293062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6cee-a4b8-4d1e-932b-8b187f6ed95a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.308444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d6cee-a4b8-4d1e-932b-8b187f6ed95a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.310455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d6cee-a4b8-4d1e-932b-8b187f6ed95a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-ad1d6cee-a4b8-4d1e-932b-8b187f6ed95a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:58.335909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:58.337255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:58.343115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:58.343115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:58.343115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:58.343115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:03:58.343115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 607/1215] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:58.345637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe16b55-a548-426c-bc9e-016f09559087 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.418910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:58.463722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe16b55-a548-426c-bc9e-016f09559087 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.499815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe04c3e-3a77-4032-ba1c-60867670f1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.501791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe04c3e-3a77-4032-ba1c-60867670f1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.501791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe04c3e-3a77-4032-ba1c-60867670f1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.501791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe04c3e-3a77-4032-ba1c-60867670f1d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.502061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe04c3e-3a77-4032-ba1c-60867670f1d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:58.502412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe04c3e-3a77-4032-ba1c-60867670f1d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.503916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe04c3e-3a77-4032-ba1c-60867670f1d0 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.516307 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 609/1216] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:58.522047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d6cee-a4b8-4d1e-932b-8b187f6ed95a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.602313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:58.636080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d6cee-a4b8-4d1e-932b-8b187f6ed95a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.674013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ece67-7128-4fc6-b49b-49e4fe11ac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.674934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ece67-7128-4fc6-b49b-49e4fe11ac99 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.675336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ece67-7128-4fc6-b49b-49e4fe11ac99 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.675746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ece67-7128-4fc6-b49b-49e4fe11ac99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.683171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ece67-7128-4fc6-b49b-49e4fe11ac99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.685272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ece67-7128-4fc6-b49b-49e4fe11ac99 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-673ece67-7128-4fc6-b49b-49e4fe11ac99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:58.701089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:58.702285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:58.703338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:58.703338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:58.703338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:58.703338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:58.703338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:58.703338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:58.703338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:58.703338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:03:58.703338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 608/1217] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:03:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:58.709165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe04c3e-3a77-4032-ba1c-60867670f1d0 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.819008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe04c3e-3a77-4032-ba1c-60867670f1d0 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.847918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:58.862084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5af7d-2f35-4935-beef-a74a97603eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.862882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5af7d-2f35-4935-beef-a74a97603eea None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.863288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5af7d-2f35-4935-beef-a74a97603eea None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.863704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5af7d-2f35-4935-beef-a74a97603eea None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.864606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5af7d-2f35-4935-beef-a74a97603eea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:58.865019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5af7d-2f35-4935-beef-a74a97603eea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.866571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5af7d-2f35-4935-beef-a74a97603eea None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.879263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 610/1218] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:03:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:58.885226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ece67-7128-4fc6-b49b-49e4fe11ac99 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.992128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ece67-7128-4fc6-b49b-49e4fe11ac99 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:59.020144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:59.027005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74e1be-f668-4be0-9807-dd359c717d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:59.027703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74e1be-f668-4be0-9807-dd359c717d34 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:59.027989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74e1be-f668-4be0-9807-dd359c717d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:59.028267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74e1be-f668-4be0-9807-dd359c717d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:59.029114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74e1be-f668-4be0-9807-dd359c717d34 None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=3b717fe1f83743eabe4be630ddbe508c) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:59.029429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74e1be-f668-4be0-9807-dd359c717d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:59.030866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74e1be-f668-4be0-9807-dd359c717d34 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:59.042031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 609/1219] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:03:58 2022] GET /identity/v3/role_assignments?user.id=3b717fe1f83743eabe4be630ddbe508c&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:01.284966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5525a-0ccd-44e0-acb2-bc98d22d440e None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:01.285573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5525a-0ccd-44e0-acb2-bc98d22d440e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:01.285573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5525a-0ccd-44e0-acb2-bc98d22d440e None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:01.286868 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 611/1220] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:01.293103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c4c40-eb90-46e4-874c-954701b0eb81 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:01.293535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c4c40-eb90-46e4-874c-954701b0eb81 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:01.293680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c4c40-eb90-46e4-874c-954701b0eb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:01.313670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5d0c4c40-eb90-46e4-874c-954701b0eb81 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:01.315186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5d0c4c40-eb90-46e4-874c-954701b0eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:01.393986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 610/1221] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:04:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:04:01.417606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5525a-0ccd-44e0-acb2-bc98d22d440e None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:01.539256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5525a-0ccd-44e0-acb2-bc98d22d440e None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:01.580739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932624e-f13e-439f-aad5-90b7d05420f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:01.581577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932624e-f13e-439f-aad5-90b7d05420f9 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:01.581872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932624e-f13e-439f-aad5-90b7d05420f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:01.582144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932624e-f13e-439f-aad5-90b7d05420f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:01.593472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932624e-f13e-439f-aad5-90b7d05420f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-9932624e-f13e-439f-aad5-90b7d05420f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:04:01.601920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:01.603002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:01.604165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 612/1222] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:01.610055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c4c40-eb90-46e4-874c-954701b0eb81 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:01.714911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c4c40-eb90-46e4-874c-954701b0eb81 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:01.739473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:01.750774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767b912-4b2a-4bd7-8719-0ba919e5b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:01.751455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767b912-4b2a-4bd7-8719-0ba919e5b523 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:01.751851 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767b912-4b2a-4bd7-8719-0ba919e5b523 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:01.752133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767b912-4b2a-4bd7-8719-0ba919e5b523 None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:01.752931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767b912-4b2a-4bd7-8719-0ba919e5b523 None admin] RBAC: Adding query filter params (name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:01.753233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767b912-4b2a-4bd7-8719-0ba919e5b523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:01.754633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767b912-4b2a-4bd7-8719-0ba919e5b523 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:01.762923 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 611/1223] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:01.769135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932624e-f13e-439f-aad5-90b7d05420f9 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:01.815346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:01.873328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932624e-f13e-439f-aad5-90b7d05420f9 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:01.911129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5424f-602f-4103-8ec4-34aff1e30dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:01.911968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5424f-602f-4103-8ec4-34aff1e30dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:01.912249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5424f-602f-4103-8ec4-34aff1e30dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:01.912551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5424f-602f-4103-8ec4-34aff1e30dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:01.923743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5424f-602f-4103-8ec4-34aff1e30dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:01.925585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5424f-602f-4103-8ec4-34aff1e30dd3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-07e5424f-602f-4103-8ec4-34aff1e30dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:01.945303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:01.946739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:01.948151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:01.948151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:01.948151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:01.948151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:01.948151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 613/1224] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:01.952949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767b912-4b2a-4bd7-8719-0ba919e5b523 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:02.066435 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767b912-4b2a-4bd7-8719-0ba919e5b523 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:02.101343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4f3e6-03f8-4511-8785-24965d2ed21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:02.102018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4f3e6-03f8-4511-8785-24965d2ed21b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:02.102306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4f3e6-03f8-4511-8785-24965d2ed21b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:02.102587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4f3e6-03f8-4511-8785-24965d2ed21b None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:02.103320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4f3e6-03f8-4511-8785-24965d2ed21b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:02.103670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4f3e6-03f8-4511-8785-24965d2ed21b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:02.105037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4f3e6-03f8-4511-8785-24965d2ed21b None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:02.116974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 612/1225] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:02.122724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5424f-602f-4103-8ec4-34aff1e30dd3 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:02.225171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:02.233688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5424f-602f-4103-8ec4-34aff1e30dd3 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:02.273582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48f27f-b135-4a14-bdb8-f9eb630d32a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:02.274408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f27f-b135-4a14-bdb8-f9eb630d32a6 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:02.274689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f27f-b135-4a14-bdb8-f9eb630d32a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:02.274958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f27f-b135-4a14-bdb8-f9eb630d32a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:02.285631 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48f27f-b135-4a14-bdb8-f9eb630d32a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:02.287388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48f27f-b135-4a14-bdb8-f9eb630d32a6 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-7c48f27f-b135-4a14-bdb8-f9eb630d32a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:04:02.305740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:02.306916 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:02.313216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:02.313216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:02.313216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:04:02.313216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:04:02.313216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:04:02.313216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:04:02.313216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:04:02.313216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:04:02.313216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:04:02.313216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:02.313216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 614/1226] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:02.315039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4f3e6-03f8-4511-8785-24965d2ed21b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:02.363802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:02.427712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4f3e6-03f8-4511-8785-24965d2ed21b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:02.465113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee1fda-b9da-4305-a058-feef2bebd085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:02.465824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee1fda-b9da-4305-a058-feef2bebd085 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:02.466105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee1fda-b9da-4305-a058-feef2bebd085 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:02.466373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee1fda-b9da-4305-a058-feef2bebd085 None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:02.467191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee1fda-b9da-4305-a058-feef2bebd085 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:02.467495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee1fda-b9da-4305-a058-feef2bebd085 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:02.468975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee1fda-b9da-4305-a058-feef2bebd085 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:02.488623 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 613/1227] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 15:04:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:02.494619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48f27f-b135-4a14-bdb8-f9eb630d32a6 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:02.602392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48f27f-b135-4a14-bdb8-f9eb630d32a6 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:02.638132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ac77d-6e6d-43e5-85b1-6b5842dbe2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:02.639174 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ac77d-6e6d-43e5-85b1-6b5842dbe2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:02.639597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ac77d-6e6d-43e5-85b1-6b5842dbe2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:02.640054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ac77d-6e6d-43e5-85b1-6b5842dbe2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:02.652906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ac77d-6e6d-43e5-85b1-6b5842dbe2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:02.654553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ac77d-6e6d-43e5-85b1-6b5842dbe2a7 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-205ac77d-6e6d-43e5-85b1-6b5842dbe2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:02.672291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:02.673303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:02.674263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:02.674263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:02.674263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:02.674263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:02.674263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 615/1228] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:02.679998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee1fda-b9da-4305-a058-feef2bebd085 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:02.809051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee1fda-b9da-4305-a058-feef2bebd085 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:02.811958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:02.855693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dee0d-abf9-4c86-a954-a42e4c6e164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:02.856373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dee0d-abf9-4c86-a954-a42e4c6e164d None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:02.856665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dee0d-abf9-4c86-a954-a42e4c6e164d None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:02.856947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dee0d-abf9-4c86-a954-a42e4c6e164d None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:02.857715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dee0d-abf9-4c86-a954-a42e4c6e164d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:02.858031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dee0d-abf9-4c86-a954-a42e4c6e164d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:02.859411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dee0d-abf9-4c86-a954-a42e4c6e164d None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:02.876170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 614/1229] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:02.878709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ac77d-6e6d-43e5-85b1-6b5842dbe2a7 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:02.888879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:02.999306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ac77d-6e6d-43e5-85b1-6b5842dbe2a7 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:03.047842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e1452-6371-4230-8350-3322291684f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:03.048663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e1452-6371-4230-8350-3322291684f3 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.048961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e1452-6371-4230-8350-3322291684f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.049263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e1452-6371-4230-8350-3322291684f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.056654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e1452-6371-4230-8350-3322291684f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:03.058119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e1452-6371-4230-8350-3322291684f3 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-207e1452-6371-4230-8350-3322291684f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:04:03.073649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:03.080970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:03.082074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:04:03.082074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:04:03.082074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:04:03.082074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:04:03.082074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:04:03.082074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:04:03.082074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:03.082074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:03.082074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 616/1230] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:03.082896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dee0d-abf9-4c86-a954-a42e4c6e164d None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:03.188220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dee0d-abf9-4c86-a954-a42e4c6e164d None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:03.230286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c8d0c-3216-45c8-b544-32200d2632c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:03.230959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c8d0c-3216-45c8-b544-32200d2632c3 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.231241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c8d0c-3216-45c8-b544-32200d2632c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.231516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c8d0c-3216-45c8-b544-32200d2632c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.232345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c8d0c-3216-45c8-b544-32200d2632c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:03.232659 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c8d0c-3216-45c8-b544-32200d2632c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:03.234089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c8d0c-3216-45c8-b544-32200d2632c3 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:03.246572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 615/1231] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:03.254104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e1452-6371-4230-8350-3322291684f3 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:03.337543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:03.374865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e1452-6371-4230-8350-3322291684f3 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:03.410826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5bee3-28fc-4611-aa80-c45d33de7e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:03.411840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5bee3-28fc-4611-aa80-c45d33de7e41 None admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.412128 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5bee3-28fc-4611-aa80-c45d33de7e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.412410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5bee3-28fc-4611-aa80-c45d33de7e41 None admin] PATH_INFO: `/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/3b717fe1f83743eabe4be630ddbe508c/roles/4e05103edb314958aba7aa66c8747306` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.427787 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5bee3-28fc-4611-aa80-c45d33de7e41 None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ad2e4552f43f09ebf85b6c82a5481, user_id=3b717fe1f83743eabe4be630ddbe508c, role_id=4e05103edb314958aba7aa66c8747306)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:03.429316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5bee3-28fc-4611-aa80-c45d33de7e41 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:03.445725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 617/1232] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:04:03 2022] PUT /identity/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/3b717fe1f83743eabe4be630ddbe508c/roles/4e05103edb314958aba7aa66c8747306 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:04:05.760701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10358fe6-be16-4570-9060-716d53e0ac5b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.761242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10358fe6-be16-4570-9060-716d53e0ac5b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.761242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10358fe6-be16-4570-9060-716d53e0ac5b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.762542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 616/1233] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:05.771496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86271293-757b-4a05-a6e3-c6edd661cc83 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.771496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86271293-757b-4a05-a6e3-c6edd661cc83 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.771496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86271293-757b-4a05-a6e3-c6edd661cc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.787652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-86271293-757b-4a05-a6e3-c6edd661cc83 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:05.788899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-86271293-757b-4a05-a6e3-c6edd661cc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:05.861434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 618/1234] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:04:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:05.885464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10358fe6-be16-4570-9060-716d53e0ac5b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:05.914352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.001099 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10358fe6-be16-4570-9060-716d53e0ac5b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.035779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247d4ec-4488-41a9-b78d-c4ec89fe0f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.036591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247d4ec-4488-41a9-b78d-c4ec89fe0f8b None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.036879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247d4ec-4488-41a9-b78d-c4ec89fe0f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.037160 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247d4ec-4488-41a9-b78d-c4ec89fe0f8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.053197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247d4ec-4488-41a9-b78d-c4ec89fe0f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-d247d4ec-4488-41a9-b78d-c4ec89fe0f8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:04:06.062399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:06.063479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:06.064365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 617/1235] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 15:04:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:06.069983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86271293-757b-4a05-a6e3-c6edd661cc83 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.119495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.185081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86271293-757b-4a05-a6e3-c6edd661cc83 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.222984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82283b54-898a-4f66-bc86-a1d0b15816a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.223779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82283b54-898a-4f66-bc86-a1d0b15816a0 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.224089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82283b54-898a-4f66-bc86-a1d0b15816a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.224407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82283b54-898a-4f66-bc86-a1d0b15816a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.225218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82283b54-898a-4f66-bc86-a1d0b15816a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:06.225555 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82283b54-898a-4f66-bc86-a1d0b15816a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.227031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82283b54-898a-4f66-bc86-a1d0b15816a0 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.240391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 619/1236] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 15:04:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:06.241733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247d4ec-4488-41a9-b78d-c4ec89fe0f8b None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.339775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.357965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247d4ec-4488-41a9-b78d-c4ec89fe0f8b None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.395794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dbcbd-f445-4f19-9f8d-2d63ad924d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.396605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dbcbd-f445-4f19-9f8d-2d63ad924d07 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.396893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dbcbd-f445-4f19-9f8d-2d63ad924d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.397173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dbcbd-f445-4f19-9f8d-2d63ad924d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.408147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dbcbd-f445-4f19-9f8d-2d63ad924d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.409724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dbcbd-f445-4f19-9f8d-2d63ad924d07 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-120dbcbd-f445-4f19-9f8d-2d63ad924d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:06.427258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:06.437634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:06.438715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:06.438715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:06.438715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:06.438715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:06.438715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 618/1237] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:06.439025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82283b54-898a-4f66-bc86-a1d0b15816a0 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.559393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82283b54-898a-4f66-bc86-a1d0b15816a0 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.569870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.598729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f45c5-636c-4a2f-877a-227be3055ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.599365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f45c5-636c-4a2f-877a-227be3055ebf None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.599752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f45c5-636c-4a2f-877a-227be3055ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.600078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f45c5-636c-4a2f-877a-227be3055ebf None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.600873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f45c5-636c-4a2f-877a-227be3055ebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:06.601182 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f45c5-636c-4a2f-877a-227be3055ebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.602569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f45c5-636c-4a2f-877a-227be3055ebf None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.615053 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 620/1238] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:06.621433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dbcbd-f445-4f19-9f8d-2d63ad924d07 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.740573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dbcbd-f445-4f19-9f8d-2d63ad924d07 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.778000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadf8af-15c3-431d-a9d0-531f2bae6a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.779024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadf8af-15c3-431d-a9d0-531f2bae6a72 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.779444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadf8af-15c3-431d-a9d0-531f2bae6a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.779865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadf8af-15c3-431d-a9d0-531f2bae6a72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.782983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.789139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadf8af-15c3-431d-a9d0-531f2bae6a72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.791169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadf8af-15c3-431d-a9d0-531f2bae6a72 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-8aadf8af-15c3-431d-a9d0-531f2bae6a72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:04:06.806822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:06.808115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:06.809884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:06.809884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:06.809884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:04:06.809884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:04:06.809884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:04:06.809884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:04:06.809884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:04:06.809884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:04:06.809884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:04:06.809884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:06.809884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 619/1239] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:04:06.814636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f45c5-636c-4a2f-877a-227be3055ebf None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.927152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f45c5-636c-4a2f-877a-227be3055ebf None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.966261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc419e-7ba3-4ee7-b72b-55d9e2ccfb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.967023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc419e-7ba3-4ee7-b72b-55d9e2ccfb7b None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.967328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc419e-7ba3-4ee7-b72b-55d9e2ccfb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.967652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc419e-7ba3-4ee7-b72b-55d9e2ccfb7b None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.968614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc419e-7ba3-4ee7-b72b-55d9e2ccfb7b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:06.968917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc419e-7ba3-4ee7-b72b-55d9e2ccfb7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.970437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc419e-7ba3-4ee7-b72b-55d9e2ccfb7b None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.990177 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 621/1240] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 15:04:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:06.996124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadf8af-15c3-431d-a9d0-531f2bae6a72 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.107003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadf8af-15c3-431d-a9d0-531f2bae6a72 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.145073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1368a4-fc7f-4bbf-b674-5128a3e5754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.145737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1368a4-fc7f-4bbf-b674-5128a3e5754f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.146024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1368a4-fc7f-4bbf-b674-5128a3e5754f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.146302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1368a4-fc7f-4bbf-b674-5128a3e5754f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.210871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:07.219048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1368a4-fc7f-4bbf-b674-5128a3e5754f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.220857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1368a4-fc7f-4bbf-b674-5128a3e5754f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.337619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 620/1241] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:04:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:04:07.343958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc419e-7ba3-4ee7-b72b-55d9e2ccfb7b None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.378564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:07.459003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc419e-7ba3-4ee7-b72b-55d9e2ccfb7b None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.497573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5da8d-9a41-461d-8b8e-74b2c6c4a53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.498407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5da8d-9a41-461d-8b8e-74b2c6c4a53d None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.498722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5da8d-9a41-461d-8b8e-74b2c6c4a53d None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.499003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5da8d-9a41-461d-8b8e-74b2c6c4a53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.510793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5da8d-9a41-461d-8b8e-74b2c6c4a53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.512685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5da8d-9a41-461d-8b8e-74b2c6c4a53d None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-71a5da8d-9a41-461d-8b8e-74b2c6c4a53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:07.531547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:07.532847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:07.538135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:07.538135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:07.538135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:07.538135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:07.538135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 622/1242] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:07.539373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1368a4-fc7f-4bbf-b674-5128a3e5754f None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.644708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:07.652031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1368a4-fc7f-4bbf-b674-5128a3e5754f None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.698268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647d1b9-54f5-4bca-9d6d-547d389b7f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.698955 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647d1b9-54f5-4bca-9d6d-547d389b7f63 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.699245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647d1b9-54f5-4bca-9d6d-547d389b7f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.699528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647d1b9-54f5-4bca-9d6d-547d389b7f63 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.700301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647d1b9-54f5-4bca-9d6d-547d389b7f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:07.700613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647d1b9-54f5-4bca-9d6d-547d389b7f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.702037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647d1b9-54f5-4bca-9d6d-547d389b7f63 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.714443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 621/1243] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:07.720245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5da8d-9a41-461d-8b8e-74b2c6c4a53d None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.804589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:07.826997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5da8d-9a41-461d-8b8e-74b2c6c4a53d None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.862400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d637da-076a-4dd0-a5a5-3b132c59ee46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.863283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d637da-076a-4dd0-a5a5-3b132c59ee46 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.863590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d637da-076a-4dd0-a5a5-3b132c59ee46 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.863872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d637da-076a-4dd0-a5a5-3b132c59ee46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.871151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d637da-076a-4dd0-a5a5-3b132c59ee46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.872797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d637da-076a-4dd0-a5a5-3b132c59ee46 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-a8d637da-076a-4dd0-a5a5-3b132c59ee46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:04:07.887715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:07.888884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:07.890017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:04:07.890017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:04:07.890017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:04:07.890017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:04:07.890017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:04:07.890017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:04:07.890017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:07.890017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:07.895608 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 623/1244] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:04:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:07.895822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647d1b9-54f5-4bca-9d6d-547d389b7f63 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:08.007230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647d1b9-54f5-4bca-9d6d-547d389b7f63 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:08.043186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cebad-7c75-4e19-aca1-ca8ed203fa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:08.043894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cebad-7c75-4e19-aca1-ca8ed203fa74 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:08.044180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cebad-7c75-4e19-aca1-ca8ed203fa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:08.044455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cebad-7c75-4e19-aca1-ca8ed203fa74 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:08.045261 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cebad-7c75-4e19-aca1-ca8ed203fa74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:08.045580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cebad-7c75-4e19-aca1-ca8ed203fa74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:08.047014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cebad-7c75-4e19-aca1-ca8ed203fa74 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:08.060320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 622/1245] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:04:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:08.066870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d637da-076a-4dd0-a5a5-3b132c59ee46 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:08.185233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d637da-076a-4dd0-a5a5-3b132c59ee46 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:08.220220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1c21-525c-4d12-a538-f32702e333e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:08.221042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1c21-525c-4d12-a538-f32702e333e2 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:08.221330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1c21-525c-4d12-a538-f32702e333e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:08.221612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1c21-525c-4d12-a538-f32702e333e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:08.222593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac1c21-525c-4d12-a538-f32702e333e2 None admin] RBAC: Adding query filter params (role.id=4e05103edb314958aba7aa66c8747306, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=3b717fe1f83743eabe4be630ddbe508c) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:08.222867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac1c21-525c-4d12-a538-f32702e333e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:08.224343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac1c21-525c-4d12-a538-f32702e333e2 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:08.230207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 624/1246] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:04:08 2022] GET /identity/v3/role_assignments?user.id=3b717fe1f83743eabe4be630ddbe508c&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=4e05103edb314958aba7aa66c8747306 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:10.803672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959bb64-df9c-4a7e-835c-c4f319e5e3f5 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:10.804262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959bb64-df9c-4a7e-835c-c4f319e5e3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:10.804262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959bb64-df9c-4a7e-835c-c4f319e5e3f5 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:10.805562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 623/1247] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:10.811754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838d1d-44f4-4eb0-a181-4870d4fb281a None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:10.812262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838d1d-44f4-4eb0-a181-4870d4fb281a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:10.812353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838d1d-44f4-4eb0-a181-4870d4fb281a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:10.818080 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:10.831382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-aa838d1d-44f4-4eb0-a181-4870d4fb281a None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:10.832680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-aa838d1d-44f4-4eb0-a181-4870d4fb281a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:10.909744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 625/1248] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:04:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:10.935173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959bb64-df9c-4a7e-835c-c4f319e5e3f5 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:10.957286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:11.057019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959bb64-df9c-4a7e-835c-c4f319e5e3f5 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:11.097516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79b65-136f-4c42-8347-6a1e9d4dc7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:11.098436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79b65-136f-4c42-8347-6a1e9d4dc7ed None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:11.098716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79b65-136f-4c42-8347-6a1e9d4dc7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:11.099009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79b65-136f-4c42-8347-6a1e9d4dc7ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:11.111395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f79b65-136f-4c42-8347-6a1e9d4dc7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-87f79b65-136f-4c42-8347-6a1e9d4dc7ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:04:11.120852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:11.122058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:11.128521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 624/1249] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:04:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:11.129424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838d1d-44f4-4eb0-a181-4870d4fb281a None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:11.241262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838d1d-44f4-4eb0-a181-4870d4fb281a None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:11.275541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:11.282071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b0161-357c-4995-a1ea-55609fe2bcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:11.282922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b0161-357c-4995-a1ea-55609fe2bcfb None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:11.283226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b0161-357c-4995-a1ea-55609fe2bcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:11.283504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b0161-357c-4995-a1ea-55609fe2bcfb None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:11.284570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b0161-357c-4995-a1ea-55609fe2bcfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:11.284917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b0161-357c-4995-a1ea-55609fe2bcfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:11.286829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b0161-357c-4995-a1ea-55609fe2bcfb None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:11.297205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 626/1250] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:04:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:11.303149 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79b65-136f-4c42-8347-6a1e9d4dc7ed None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:11.405196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:11.431049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f79b65-136f-4c42-8347-6a1e9d4dc7ed None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:11.470538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff00cc7-35f1-47dd-88bd-5da725d15dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:11.471389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff00cc7-35f1-47dd-88bd-5da725d15dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:11.471734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff00cc7-35f1-47dd-88bd-5da725d15dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:11.472017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff00cc7-35f1-47dd-88bd-5da725d15dc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:11.483867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff00cc7-35f1-47dd-88bd-5da725d15dc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:11.485496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff00cc7-35f1-47dd-88bd-5da725d15dc8 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-bff00cc7-35f1-47dd-88bd-5da725d15dc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:11.505457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:11.506603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:11.507508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:11.507508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:11.507508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:11.507508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:11.507508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 625/1251] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:11.512686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b0161-357c-4995-a1ea-55609fe2bcfb None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:11.624571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b0161-357c-4995-a1ea-55609fe2bcfb None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:11.659084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310adadc-8b75-4577-a79d-3261a8f2b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:11.659706 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310adadc-8b75-4577-a79d-3261a8f2b772 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:11.659988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310adadc-8b75-4577-a79d-3261a8f2b772 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:11.660263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310adadc-8b75-4577-a79d-3261a8f2b772 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:11.660998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310adadc-8b75-4577-a79d-3261a8f2b772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:11.661340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310adadc-8b75-4577-a79d-3261a8f2b772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:11.662757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310adadc-8b75-4577-a79d-3261a8f2b772 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:11.676152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 627/1252] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:11.682349 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff00cc7-35f1-47dd-88bd-5da725d15dc8 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:11.799369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff00cc7-35f1-47dd-88bd-5da725d15dc8 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:11.827455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:11.836290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806f5e5-6883-420a-8817-8071ad3df8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:11.837105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806f5e5-6883-420a-8817-8071ad3df8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:11.837389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806f5e5-6883-420a-8817-8071ad3df8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:11.837637 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806f5e5-6883-420a-8817-8071ad3df8f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:11.845638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806f5e5-6883-420a-8817-8071ad3df8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:11.847348 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806f5e5-6883-420a-8817-8071ad3df8f0 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-9806f5e5-6883-420a-8817-8071ad3df8f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:04:11.863105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:11.864378 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:11.865579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:11.865579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:11.865579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:04:11.865579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:04:11.865579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:04:11.865579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:04:11.865579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:04:11.865579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:04:11.865579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:04:11.865579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:11.865579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 626/1253] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:11.873137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310adadc-8b75-4577-a79d-3261a8f2b772 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:11.934300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:11.982117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310adadc-8b75-4577-a79d-3261a8f2b772 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:12.019161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c755827-6363-4b35-b7d7-2cc38bc86f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:12.019881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c755827-6363-4b35-b7d7-2cc38bc86f66 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:12.020189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c755827-6363-4b35-b7d7-2cc38bc86f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:12.020457 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c755827-6363-4b35-b7d7-2cc38bc86f66 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:12.021372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c755827-6363-4b35-b7d7-2cc38bc86f66 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:12.021757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c755827-6363-4b35-b7d7-2cc38bc86f66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:12.023212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c755827-6363-4b35-b7d7-2cc38bc86f66 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:12.042741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 628/1254] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 15:04:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:12.048929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806f5e5-6883-420a-8817-8071ad3df8f0 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:12.159929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806f5e5-6883-420a-8817-8071ad3df8f0 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:12.202602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073b349-f866-414d-9e9e-02374256cb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:12.203276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073b349-f866-414d-9e9e-02374256cb75 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:12.203671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073b349-f866-414d-9e9e-02374256cb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:12.203980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073b349-f866-414d-9e9e-02374256cb75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:12.270872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:12.291330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073b349-f866-414d-9e9e-02374256cb75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:12.293748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073b349-f866-414d-9e9e-02374256cb75 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:12.404079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 627/1255] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:04:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:04:12.411038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c755827-6363-4b35-b7d7-2cc38bc86f66 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:12.532275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c755827-6363-4b35-b7d7-2cc38bc86f66 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:12.546751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:12.572593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8993e-2520-4bc1-b887-d5af1fb8151f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:12.573479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8993e-2520-4bc1-b887-d5af1fb8151f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:12.573747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8993e-2520-4bc1-b887-d5af1fb8151f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:12.574057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8993e-2520-4bc1-b887-d5af1fb8151f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:12.584684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8993e-2520-4bc1-b887-d5af1fb8151f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:12.586151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8993e-2520-4bc1-b887-d5af1fb8151f None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-c1e8993e-2520-4bc1-b887-d5af1fb8151f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:12.606265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:12.607332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:12.608292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:12.608292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:12.608292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:12.608292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:12.608292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 629/1256] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:12.614176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073b349-f866-414d-9e9e-02374256cb75 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:12.711260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:12.724996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073b349-f866-414d-9e9e-02374256cb75 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:12.762207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7311e4-275f-4c56-b339-10da29b5cea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:12.762980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7311e4-275f-4c56-b339-10da29b5cea6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:12.763298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7311e4-275f-4c56-b339-10da29b5cea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:12.763664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7311e4-275f-4c56-b339-10da29b5cea6 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:12.764426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7311e4-275f-4c56-b339-10da29b5cea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:12.764737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7311e4-275f-4c56-b339-10da29b5cea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:12.766115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7311e4-275f-4c56-b339-10da29b5cea6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:12.778608 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 628/1257] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:12.785341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8993e-2520-4bc1-b887-d5af1fb8151f None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:12.909490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8993e-2520-4bc1-b887-d5af1fb8151f None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:12.964877 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ca07e-9f8c-41ce-b470-ecea90244659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:12.965714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca07e-9f8c-41ce-b470-ecea90244659 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:12.966011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca07e-9f8c-41ce-b470-ecea90244659 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:12.966282 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca07e-9f8c-41ce-b470-ecea90244659 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:12.984697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ca07e-9f8c-41ce-b470-ecea90244659 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:12.986249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ca07e-9f8c-41ce-b470-ecea90244659 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-cc0ca07e-9f8c-41ce-b470-ecea90244659 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:04:13.001351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:13.003194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:13.004965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:04:13.004965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:04:13.004965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:04:13.004965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:04:13.004965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:04:13.004965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:04:13.004965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:13.004965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:13.004965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 630/1258] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:04:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:04:13.009050 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7311e4-275f-4c56-b339-10da29b5cea6 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:13.119837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7311e4-275f-4c56-b339-10da29b5cea6 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:13.155485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9da19-0bb8-4ab4-b4ea-20bbd92cd7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:13.156192 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9da19-0bb8-4ab4-b4ea-20bbd92cd7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:13.156481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9da19-0bb8-4ab4-b4ea-20bbd92cd7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:13.156762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9da19-0bb8-4ab4-b4ea-20bbd92cd7a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:13.157577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9da19-0bb8-4ab4-b4ea-20bbd92cd7a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:13.157956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9da19-0bb8-4ab4-b4ea-20bbd92cd7a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:13.159416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9da19-0bb8-4ab4-b4ea-20bbd92cd7a6 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:13.172739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 629/1259] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:04:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:13.179165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ca07e-9f8c-41ce-b470-ecea90244659 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:13.207215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:13.300677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ca07e-9f8c-41ce-b470-ecea90244659 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:13.346120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05563451-101e-4cfc-b185-1b42aaebb072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:13.346797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05563451-101e-4cfc-b185-1b42aaebb072 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:13.347083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05563451-101e-4cfc-b185-1b42aaebb072 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:13.347358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05563451-101e-4cfc-b185-1b42aaebb072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:13.348257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05563451-101e-4cfc-b185-1b42aaebb072 None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=3b717fe1f83743eabe4be630ddbe508c) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:13.348572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05563451-101e-4cfc-b185-1b42aaebb072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:13.350038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05563451-101e-4cfc-b185-1b42aaebb072 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:13.356681 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 631/1260] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:04:13 2022] GET /identity/v3/role_assignments?user.id=3b717fe1f83743eabe4be630ddbe508c&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:15.620231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e79ce3-3920-454c-816c-6c8eef3731ea None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:15.620825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e79ce3-3920-454c-816c-6c8eef3731ea None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:15.620825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e79ce3-3920-454c-816c-6c8eef3731ea None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:15.622845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 630/1261] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:15.628359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9518b-df3a-4f79-900b-7da4b88c0ed5 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:15.628886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9518b-df3a-4f79-900b-7da4b88c0ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:15.628989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9518b-df3a-4f79-900b-7da4b88c0ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:15.647350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-80f9518b-df3a-4f79-900b-7da4b88c0ed5 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:15.648608 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-80f9518b-df3a-4f79-900b-7da4b88c0ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:15.718388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 632/1262] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:04:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:15.742654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e79ce3-3920-454c-816c-6c8eef3731ea None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:15.754614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:15.860497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e79ce3-3920-454c-816c-6c8eef3731ea None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:15.895267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277f4b-843b-47d8-963e-939314e086fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:15.896096 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277f4b-843b-47d8-963e-939314e086fa None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:15.896379 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277f4b-843b-47d8-963e-939314e086fa None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:15.896654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277f4b-843b-47d8-963e-939314e086fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:15.906870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb277f4b-843b-47d8-963e-939314e086fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-eb277f4b-843b-47d8-963e-939314e086fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:04:15.914577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:15.915722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:15.916651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 631/1263] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:04:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:15.922006 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9518b-df3a-4f79-900b-7da4b88c0ed5 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:15.942697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:16.028101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9518b-df3a-4f79-900b-7da4b88c0ed5 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:16.063426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849108d-f793-4712-84b6-9c433611db3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:16.064175 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849108d-f793-4712-84b6-9c433611db3c None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:16.064461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849108d-f793-4712-84b6-9c433611db3c None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:16.064745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849108d-f793-4712-84b6-9c433611db3c None admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:16.065511 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849108d-f793-4712-84b6-9c433611db3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:16.065823 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849108d-f793-4712-84b6-9c433611db3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:16.067218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849108d-f793-4712-84b6-9c433611db3c None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:16.075462 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 633/1264] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:04:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:16.081719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277f4b-843b-47d8-963e-939314e086fa None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:16.152327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:16.187363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277f4b-843b-47d8-963e-939314e086fa None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:16.221810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e0521-cc13-4d20-ba38-f478ee85e20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:16.222612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e0521-cc13-4d20-ba38-f478ee85e20e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:16.222895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e0521-cc13-4d20-ba38-f478ee85e20e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:16.223174 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e0521-cc13-4d20-ba38-f478ee85e20e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:16.234125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e0521-cc13-4d20-ba38-f478ee85e20e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:16.235597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e0521-cc13-4d20-ba38-f478ee85e20e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-412e0521-cc13-4d20-ba38-f478ee85e20e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:16.253214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:16.254645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:16.255813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:16.255813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:16.255813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:16.255813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:16.255813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 632/1265] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:16.261394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849108d-f793-4712-84b6-9c433611db3c None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:16.361614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:16.382557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849108d-f793-4712-84b6-9c433611db3c None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:16.419531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb301a-c534-4e7e-b71d-468ea045e298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:16.420238 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb301a-c534-4e7e-b71d-468ea045e298 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:16.420524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb301a-c534-4e7e-b71d-468ea045e298 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:16.420801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb301a-c534-4e7e-b71d-468ea045e298 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:16.421537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb301a-c534-4e7e-b71d-468ea045e298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:16.421851 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb301a-c534-4e7e-b71d-468ea045e298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:16.423264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb301a-c534-4e7e-b71d-468ea045e298 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:16.435845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 634/1266] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:16.441885 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e0521-cc13-4d20-ba38-f478ee85e20e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:16.545801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e0521-cc13-4d20-ba38-f478ee85e20e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:16.565410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:16.582016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08037c10-a7df-4f88-8bb8-ebff220caf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:16.582832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08037c10-a7df-4f88-8bb8-ebff220caf5a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:16.583118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08037c10-a7df-4f88-8bb8-ebff220caf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:16.583389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08037c10-a7df-4f88-8bb8-ebff220caf5a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:16.591443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08037c10-a7df-4f88-8bb8-ebff220caf5a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:16.592934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08037c10-a7df-4f88-8bb8-ebff220caf5a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-08037c10-a7df-4f88-8bb8-ebff220caf5a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:04:16.607002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:16.608196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:16.609355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:16.609355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:16.609355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:04:16.609355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:04:16.609355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:04:16.609355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:04:16.609355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:04:16.609355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:04:16.609355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:04:16.609355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:16.609355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 633/1267] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:16.614278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb301a-c534-4e7e-b71d-468ea045e298 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:16.712816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb301a-c534-4e7e-b71d-468ea045e298 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:16.747870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51abfd3-4d43-4b52-a2a0-6af8762cce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:16.748539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51abfd3-4d43-4b52-a2a0-6af8762cce51 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:16.748832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51abfd3-4d43-4b52-a2a0-6af8762cce51 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:16.749112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51abfd3-4d43-4b52-a2a0-6af8762cce51 None admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:16.749964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51abfd3-4d43-4b52-a2a0-6af8762cce51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:16.750272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51abfd3-4d43-4b52-a2a0-6af8762cce51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:16.751795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51abfd3-4d43-4b52-a2a0-6af8762cce51 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:16.760799 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:16.769873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 635/1268] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 15:04:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:16.775819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08037c10-a7df-4f88-8bb8-ebff220caf5a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:16.879786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08037c10-a7df-4f88-8bb8-ebff220caf5a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:16.914866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db15101-7dd2-4509-82e2-7a65d70f9d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:16.915699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db15101-7dd2-4509-82e2-7a65d70f9d76 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:16.915984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db15101-7dd2-4509-82e2-7a65d70f9d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:16.916260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db15101-7dd2-4509-82e2-7a65d70f9d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:16.926949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db15101-7dd2-4509-82e2-7a65d70f9d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:16.928426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db15101-7dd2-4509-82e2-7a65d70f9d76 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-2db15101-7dd2-4509-82e2-7a65d70f9d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:16.945977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:16.947018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:16.948014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:16.948014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:16.948014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:16.948014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:16.948014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 634/1269] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:16.953224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51abfd3-4d43-4b52-a2a0-6af8762cce51 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:17.055600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51abfd3-4d43-4b52-a2a0-6af8762cce51 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:17.090376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66432d2a-ea5b-469b-ba2c-b68a2cfb16de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:17.091030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66432d2a-ea5b-469b-ba2c-b68a2cfb16de None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:17.091320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66432d2a-ea5b-469b-ba2c-b68a2cfb16de None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:17.091549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66432d2a-ea5b-469b-ba2c-b68a2cfb16de None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:17.092341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66432d2a-ea5b-469b-ba2c-b68a2cfb16de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:17.092647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66432d2a-ea5b-469b-ba2c-b68a2cfb16de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:17.094029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66432d2a-ea5b-469b-ba2c-b68a2cfb16de None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:17.105340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 636/1270] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:17.111346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db15101-7dd2-4509-82e2-7a65d70f9d76 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:17.143146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:17.213148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db15101-7dd2-4509-82e2-7a65d70f9d76 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:17.252709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c25c39-3770-44a9-b719-85311b36db72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:17.253524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c25c39-3770-44a9-b719-85311b36db72 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:17.253891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c25c39-3770-44a9-b719-85311b36db72 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:17.254222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c25c39-3770-44a9-b719-85311b36db72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:17.262864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c25c39-3770-44a9-b719-85311b36db72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:17.264862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c25c39-3770-44a9-b719-85311b36db72 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-a8c25c39-3770-44a9-b719-85311b36db72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:04:17.284640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:17.285685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:17.286593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:04:17.286593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:04:17.286593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:04:17.286593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:04:17.286593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:04:17.286593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:04:17.286593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:17.286593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:17.286593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 635/1271] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:17.293119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66432d2a-ea5b-469b-ba2c-b68a2cfb16de None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:17.353354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:17.395949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66432d2a-ea5b-469b-ba2c-b68a2cfb16de None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:17.430122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0353fea-1f58-4c22-817b-3d1d9f218ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:17.430780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0353fea-1f58-4c22-817b-3d1d9f218ced None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:17.431057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0353fea-1f58-4c22-817b-3d1d9f218ced None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:17.431333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0353fea-1f58-4c22-817b-3d1d9f218ced None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:17.432154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0353fea-1f58-4c22-817b-3d1d9f218ced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:17.432463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0353fea-1f58-4c22-817b-3d1d9f218ced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:17.434215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0353fea-1f58-4c22-817b-3d1d9f218ced None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:17.446484 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 637/1272] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:04:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:17.452531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c25c39-3770-44a9-b719-85311b36db72 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:17.553418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:17.563357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c25c39-3770-44a9-b719-85311b36db72 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:17.598017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82131cd-907f-43cf-9818-44187cc60ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:17.598910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82131cd-907f-43cf-9818-44187cc60ff2 None admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:17.599198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82131cd-907f-43cf-9818-44187cc60ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:17.599480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82131cd-907f-43cf-9818-44187cc60ff2 None admin] PATH_INFO: `/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/3b717fe1f83743eabe4be630ddbe508c/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:17.601490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82131cd-907f-43cf-9818-44187cc60ff2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ad2e4552f43f09ebf85b6c82a5481, user_id=3b717fe1f83743eabe4be630ddbe508c, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:17.602938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82131cd-907f-43cf-9818-44187cc60ff2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:17.619925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 636/1273] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 15:04:17 2022] PUT /identity/v3/projects/e94ad2e4552f43f09ebf85b6c82a5481/users/3b717fe1f83743eabe4be630ddbe508c/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:04:19.774942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061608f6-ddb6-4e3b-8c3b-9bb4adc76b54 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:19.775767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061608f6-ddb6-4e3b-8c3b-9bb4adc76b54 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:19.775767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061608f6-ddb6-4e3b-8c3b-9bb4adc76b54 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:19.777982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 638/1274] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:04:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:19.784226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf265f5-6532-4484-8357-7976339adb41 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:19.784650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf265f5-6532-4484-8357-7976339adb41 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:19.784824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf265f5-6532-4484-8357-7976339adb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:19.803815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1bf265f5-6532-4484-8357-7976339adb41 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:19.804940 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1bf265f5-6532-4484-8357-7976339adb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:19.875098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 637/1275] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:04:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:19.911997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061608f6-ddb6-4e3b-8c3b-9bb4adc76b54 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:20.025215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061608f6-ddb6-4e3b-8c3b-9bb4adc76b54 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:20.045448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:20.065040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2396c3-2d85-4197-b1a8-564123ee6a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:20.065838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2396c3-2d85-4197-b1a8-564123ee6a19 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:20.066126 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2396c3-2d85-4197-b1a8-564123ee6a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:20.066404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2396c3-2d85-4197-b1a8-564123ee6a19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:20.077694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2396c3-2d85-4197-b1a8-564123ee6a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-bd2396c3-2d85-4197-b1a8-564123ee6a19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:04:20.085421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:20.086533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:20.087503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 639/1276] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 15:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:20.092977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf265f5-6532-4484-8357-7976339adb41 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:20.174546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:20.197493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf265f5-6532-4484-8357-7976339adb41 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:20.232712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9f4c7-cc26-4a9c-8a3c-e50b4935a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:20.233376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9f4c7-cc26-4a9c-8a3c-e50b4935a7ff None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:20.233660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9f4c7-cc26-4a9c-8a3c-e50b4935a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:20.233937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9f4c7-cc26-4a9c-8a3c-e50b4935a7ff None admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:20.234692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9f4c7-cc26-4a9c-8a3c-e50b4935a7ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:20.235000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9f4c7-cc26-4a9c-8a3c-e50b4935a7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:20.236441 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9f4c7-cc26-4a9c-8a3c-e50b4935a7ff None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:20.244567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 638/1277] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 15:04:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:20.251461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2396c3-2d85-4197-b1a8-564123ee6a19 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:20.361710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2396c3-2d85-4197-b1a8-564123ee6a19 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:20.398085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d27610-304d-4845-9627-f5d38f394b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:20.398882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d27610-304d-4845-9627-f5d38f394b93 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:20.399162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d27610-304d-4845-9627-f5d38f394b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:20.399431 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d27610-304d-4845-9627-f5d38f394b93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:20.411746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d27610-304d-4845-9627-f5d38f394b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:20.414429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d27610-304d-4845-9627-f5d38f394b93 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-23d27610-304d-4845-9627-f5d38f394b93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:20.437117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:20.438156 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:20.439671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:20.439671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:20.439671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:20.439671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:20.439671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 640/1278] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:20.447184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9f4c7-cc26-4a9c-8a3c-e50b4935a7ff None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:20.551582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9f4c7-cc26-4a9c-8a3c-e50b4935a7ff None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:20.589755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8b12-0902-4fb8-ace5-80083c5ca7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:20.590411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8b12-0902-4fb8-ace5-80083c5ca7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:20.590694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8b12-0902-4fb8-ace5-80083c5ca7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:20.590970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8b12-0902-4fb8-ace5-80083c5ca7d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:20.591730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d8b12-0902-4fb8-ace5-80083c5ca7d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:20.592043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d8b12-0902-4fb8-ace5-80083c5ca7d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:20.593406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d8b12-0902-4fb8-ace5-80083c5ca7d1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:20.605028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 639/1279] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:20.611162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d27610-304d-4845-9627-f5d38f394b93 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:20.643225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:20.715163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d27610-304d-4845-9627-f5d38f394b93 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:20.752993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e36cd-b23d-46cf-82fc-9ae537626086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:20.753786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e36cd-b23d-46cf-82fc-9ae537626086 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:20.754069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e36cd-b23d-46cf-82fc-9ae537626086 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:20.754340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e36cd-b23d-46cf-82fc-9ae537626086 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:20.762638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e36cd-b23d-46cf-82fc-9ae537626086 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:20.764120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e36cd-b23d-46cf-82fc-9ae537626086 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-0a4e36cd-b23d-46cf-82fc-9ae537626086 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:04:20.779429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:20.781043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:20.782083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:20.782083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:20.782083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:04:20.782083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:04:20.782083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:04:20.782083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:04:20.782083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:04:20.782083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:04:20.782083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:04:20.782083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:20.782083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 641/1280] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:20.786708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8b12-0902-4fb8-ace5-80083c5ca7d1 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:20.792657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:20.891529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8b12-0902-4fb8-ace5-80083c5ca7d1 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:20.929808 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66b9d7-5d21-4e36-8b6f-8ec72b1cc6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:20.930400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66b9d7-5d21-4e36-8b6f-8ec72b1cc6df None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:20.930682 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66b9d7-5d21-4e36-8b6f-8ec72b1cc6df None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:20.930956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66b9d7-5d21-4e36-8b6f-8ec72b1cc6df None admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:20.931828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66b9d7-5d21-4e36-8b6f-8ec72b1cc6df None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:20.932139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66b9d7-5d21-4e36-8b6f-8ec72b1cc6df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:20.933883 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66b9d7-5d21-4e36-8b6f-8ec72b1cc6df None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:20.951155 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 640/1281] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 15:04:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:20.959941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e36cd-b23d-46cf-82fc-9ae537626086 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:21.061754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:21.072687 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e36cd-b23d-46cf-82fc-9ae537626086 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:21.105005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6235f-f585-474d-9d16-fe90aa384208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:21.105646 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6235f-f585-474d-9d16-fe90aa384208 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.105931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6235f-f585-474d-9d16-fe90aa384208 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.106209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6235f-f585-474d-9d16-fe90aa384208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.173774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6235f-f585-474d-9d16-fe90aa384208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:21.175218 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6235f-f585-474d-9d16-fe90aa384208 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:21.279758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:21.290817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 642/1282] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 15:04:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:04:21.296879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66b9d7-5d21-4e36-8b6f-8ec72b1cc6df None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:21.361938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:21.401048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66b9d7-5d21-4e36-8b6f-8ec72b1cc6df None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:21.436148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b604cbf-fddf-4be2-a41e-aa17e193693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:21.436940 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b604cbf-fddf-4be2-a41e-aa17e193693a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.437228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b604cbf-fddf-4be2-a41e-aa17e193693a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.437504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b604cbf-fddf-4be2-a41e-aa17e193693a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.448675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b604cbf-fddf-4be2-a41e-aa17e193693a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:21.450125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b604cbf-fddf-4be2-a41e-aa17e193693a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-3b604cbf-fddf-4be2-a41e-aa17e193693a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:21.468346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:21.469425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:21.470421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:21.470421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:21.470421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:21.470421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:21.470421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 641/1283] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:21.475604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6235f-f585-474d-9d16-fe90aa384208 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:21.581088 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6235f-f585-474d-9d16-fe90aa384208 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:21.619170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88431a49-19e3-448b-a808-672a9b62af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:21.619855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88431a49-19e3-448b-a808-672a9b62af90 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.620138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88431a49-19e3-448b-a808-672a9b62af90 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.620416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88431a49-19e3-448b-a808-672a9b62af90 None admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.621151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88431a49-19e3-448b-a808-672a9b62af90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:21.621456 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88431a49-19e3-448b-a808-672a9b62af90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:21.622841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88431a49-19e3-448b-a808-672a9b62af90 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:21.635009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 643/1284] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 15:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:21.641712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b604cbf-fddf-4be2-a41e-aa17e193693a None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:21.762107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b604cbf-fddf-4be2-a41e-aa17e193693a None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:21.776268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:21.811478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77e400-6d7f-4b36-ba68-fa1fce6356d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:21.812302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77e400-6d7f-4b36-ba68-fa1fce6356d2 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.812583 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77e400-6d7f-4b36-ba68-fa1fce6356d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.812858 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77e400-6d7f-4b36-ba68-fa1fce6356d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.820102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77e400-6d7f-4b36-ba68-fa1fce6356d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:21.821579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77e400-6d7f-4b36-ba68-fa1fce6356d2 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application [None req-4a77e400-6d7f-4b36-ba68-fa1fce6356d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:04:21.835517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application with Lock( May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:21.836500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:21.837901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:04:21.837901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:04:21.837901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:04:21.837901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:04:21.837901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:04:21.837901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:04:21.837901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:21.837901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: ERROR keystone.server.flask.application May 25 15:04:21.837901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 642/1285] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 15:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:21.845849 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88431a49-19e3-448b-a808-672a9b62af90 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:21.911212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:21.964006 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88431a49-19e3-448b-a808-672a9b62af90 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:22.011911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34610b2c-ae3f-427e-94af-83e9be76aba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:22.012576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34610b2c-ae3f-427e-94af-83e9be76aba7 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:22.012860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34610b2c-ae3f-427e-94af-83e9be76aba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:22.013140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34610b2c-ae3f-427e-94af-83e9be76aba7 None admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:22.013951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34610b2c-ae3f-427e-94af-83e9be76aba7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:22.014266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34610b2c-ae3f-427e-94af-83e9be76aba7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:22.015745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34610b2c-ae3f-427e-94af-83e9be76aba7 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:22.028133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 644/1286] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 15:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:22.036623 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77e400-6d7f-4b36-ba68-fa1fce6356d2 None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:22.150255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77e400-6d7f-4b36-ba68-fa1fce6356d2 None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:22.185244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a33871-f07e-4c57-a2b9-ffc596940c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:22.185897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a33871-f07e-4c57-a2b9-ffc596940c2a None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:22.186171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a33871-f07e-4c57-a2b9-ffc596940c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:22.186448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a33871-f07e-4c57-a2b9-ffc596940c2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:22.187284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a33871-f07e-4c57-a2b9-ffc596940c2a None admin] RBAC: Adding query filter params (role.id=6d2f768dab8e41468cfb393a0ed80766, scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481, user.id=3b717fe1f83743eabe4be630ddbe508c) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:22.187597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a33871-f07e-4c57-a2b9-ffc596940c2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:22.189140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a33871-f07e-4c57-a2b9-ffc596940c2a None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:22.195137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 643/1287] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 15:04:22 2022] GET /identity/v3/role_assignments?user.id=3b717fe1f83743eabe4be630ddbe508c&scope.project.id=e94ad2e4552f43f09ebf85b6c82a5481&role.id=6d2f768dab8e41468cfb393a0ed80766 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:24.410464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec825ae-dfd4-4045-8427-33a583cd631d None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.411066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec825ae-dfd4-4045-8427-33a583cd631d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.411392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec825ae-dfd4-4045-8427-33a583cd631d None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.413011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 645/1288] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:24.419401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682975cd-faaf-4e75-93d3-f5fbaa0ea067 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.420195 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682975cd-faaf-4e75-93d3-f5fbaa0ea067 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.420338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682975cd-faaf-4e75-93d3-f5fbaa0ea067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.444853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-682975cd-faaf-4e75-93d3-f5fbaa0ea067 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:24.446047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-682975cd-faaf-4e75-93d3-f5fbaa0ea067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:24.476847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:24.518933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 644/1289] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:04:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:24.552171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec825ae-dfd4-4045-8427-33a583cd631d None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:24.656541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec825ae-dfd4-4045-8427-33a583cd631d None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:24.667230 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:24.695144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f5da6-3fc6-4fd1-819b-b5a66d828d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:24.695962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5da6-3fc6-4fd1-819b-b5a66d828d14 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.696241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5da6-3fc6-4fd1-819b-b5a66d828d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.696512 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5da6-3fc6-4fd1-819b-b5a66d828d14 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.697173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f5da6-3fc6-4fd1-819b-b5a66d828d14 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:24.698543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f5da6-3fc6-4fd1-819b-b5a66d828d14 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-b86f5da6-3fc6-4fd1-819b-b5a66d828d14 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:24.711222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:24.712391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:24.713584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 646/1290] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 15:04:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:24.719200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682975cd-faaf-4e75-93d3-f5fbaa0ea067 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:24.836730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682975cd-faaf-4e75-93d3-f5fbaa0ea067 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:24.872783 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c059b4-8ee8-4002-9907-b335c73c9b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:24.873518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c059b4-8ee8-4002-9907-b335c73c9b5f None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.873811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c059b4-8ee8-4002-9907-b335c73c9b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.874091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c059b4-8ee8-4002-9907-b335c73c9b5f None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.874805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c059b4-8ee8-4002-9907-b335c73c9b5f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:24.875113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c059b4-8ee8-4002-9907-b335c73c9b5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:24.876642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c059b4-8ee8-4002-9907-b335c73c9b5f None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:24.881594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 645/1291] 10.222.0.24 () {56 vars in 1116 bytes} [Wed May 25 15:04:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:24.890421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f5da6-3fc6-4fd1-819b-b5a66d828d14 None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:25.015257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f5da6-3fc6-4fd1-819b-b5a66d828d14 None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:25.050411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0179ca-099b-4d80-a9cc-66fec204039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:25.051077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0179ca-099b-4d80-a9cc-66fec204039f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:25.051365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0179ca-099b-4d80-a9cc-66fec204039f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:25.051734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0179ca-099b-4d80-a9cc-66fec204039f None admin] PATH_INFO: `/v3/services` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:25.052395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0179ca-099b-4d80-a9cc-66fec204039f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:25.052704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0179ca-099b-4d80-a9cc-66fec204039f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:25.054089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0179ca-099b-4d80-a9cc-66fec204039f None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:25.059190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 647/1292] 10.222.0.24 () {56 vars in 1116 bytes} [Wed May 25 15:04:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:27.220258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2615f7-83fe-4bf6-bfc7-b4acf374142b None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:27.220841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2615f7-83fe-4bf6-bfc7-b4acf374142b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:27.220841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2615f7-83fe-4bf6-bfc7-b4acf374142b None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:27.222937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 646/1293] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:04:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:27.231038 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51ff29-9b9d-4b9a-bf86-768fb98cfcfd None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:27.231515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51ff29-9b9d-4b9a-bf86-768fb98cfcfd None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:27.231644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51ff29-9b9d-4b9a-bf86-768fb98cfcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:27.250451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-7b51ff29-9b9d-4b9a-bf86-768fb98cfcfd None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:27.251822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-7b51ff29-9b9d-4b9a-bf86-768fb98cfcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:27.289191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:27.334496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 648/1294] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:04:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:04:27.357248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2615f7-83fe-4bf6-bfc7-b4acf374142b None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:27.390748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:27.466752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2615f7-83fe-4bf6-bfc7-b4acf374142b None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:27.508635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cf4cd-0634-49c8-bf14-a88ca1ddd1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:27.509249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf4cd-0634-49c8-bf14-a88ca1ddd1b1 None admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:27.509533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf4cd-0634-49c8-bf14-a88ca1ddd1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:27.509813 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf4cd-0634-49c8-bf14-a88ca1ddd1b1 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:27.510562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cf4cd-0634-49c8-bf14-a88ca1ddd1b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:27.511961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cf4cd-0634-49c8-bf14-a88ca1ddd1b1 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:27.526832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 647/1295] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 15:04:27 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:29.713747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8bff0-4942-433d-a049-6abbae08c37c None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:29.714603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8bff0-4942-433d-a049-6abbae08c37c None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:29.714603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8bff0-4942-433d-a049-6abbae08c37c None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:29.716682 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 649/1296] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:04:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:29.723432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d1726-48ad-415d-b1f0-cc86cfc726cd None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:29.723855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d1726-48ad-415d-b1f0-cc86cfc726cd None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:29.724019 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d1726-48ad-415d-b1f0-cc86cfc726cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:29.742540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-531d1726-48ad-415d-b1f0-cc86cfc726cd None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:29.743764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-531d1726-48ad-415d-b1f0-cc86cfc726cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:29.833684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 648/1297] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:04:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:29.864203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8bff0-4942-433d-a049-6abbae08c37c None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:29.993808 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8bff0-4942-433d-a049-6abbae08c37c None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:30.029897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13d333-ff80-4ce6-a94d-772c0107ecbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:30.030686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13d333-ff80-4ce6-a94d-772c0107ecbf None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:30.030962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13d333-ff80-4ce6-a94d-772c0107ecbf None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:30.031233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13d333-ff80-4ce6-a94d-772c0107ecbf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:30.031921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13d333-ff80-4ce6-a94d-772c0107ecbf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:30.033320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13d333-ff80-4ce6-a94d-772c0107ecbf None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-8e13d333-ff80-4ce6-a94d-772c0107ecbf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:30.045280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:30.046424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:30.047400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 650/1298] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 15:04:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:30.055010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d1726-48ad-415d-b1f0-cc86cfc726cd None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:30.076912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:30.161312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d1726-48ad-415d-b1f0-cc86cfc726cd None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:30.199898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238daf7-f165-4e5f-a94f-05f7e1b44c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:30.200555 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238daf7-f165-4e5f-a94f-05f7e1b44c1e None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:30.200834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238daf7-f165-4e5f-a94f-05f7e1b44c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:30.201104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238daf7-f165-4e5f-a94f-05f7e1b44c1e None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:30.201816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238daf7-f165-4e5f-a94f-05f7e1b44c1e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:30.202126 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238daf7-f165-4e5f-a94f-05f7e1b44c1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:30.203482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238daf7-f165-4e5f-a94f-05f7e1b44c1e None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:30.209295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 649/1299] 10.222.0.24 () {56 vars in 1116 bytes} [Wed May 25 15:04:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:30.218518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13d333-ff80-4ce6-a94d-772c0107ecbf None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:30.252328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:30.322580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13d333-ff80-4ce6-a94d-772c0107ecbf None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:30.357421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05aeba-ed9d-487b-8bab-62591ee45c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:30.358066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05aeba-ed9d-487b-8bab-62591ee45c66 None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:30.358350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05aeba-ed9d-487b-8bab-62591ee45c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:30.358627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05aeba-ed9d-487b-8bab-62591ee45c66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:30.359423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05aeba-ed9d-487b-8bab-62591ee45c66 None admin] RBAC: Adding query filter params (interface=public, service_id=f1b713bcdce04eddafd3d6988537e4ae, region_id=RegionOne) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:30.359766 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05aeba-ed9d-487b-8bab-62591ee45c66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:30.361167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05aeba-ed9d-487b-8bab-62591ee45c66 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:30.366310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 651/1300] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 15:04:30 2022] GET /identity/v3/endpoints?service_id=f1b713bcdce04eddafd3d6988537e4ae&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:30.372211 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238daf7-f165-4e5f-a94f-05f7e1b44c1e None admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:30.458704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:30.478053 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238daf7-f165-4e5f-a94f-05f7e1b44c1e None admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:30.515326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf801ee-9057-492a-8888-cd192cb10821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:30.515947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf801ee-9057-492a-8888-cd192cb10821 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:30.516238 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf801ee-9057-492a-8888-cd192cb10821 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:30.516534 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf801ee-9057-492a-8888-cd192cb10821 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:30.517237 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf801ee-9057-492a-8888-cd192cb10821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:30.518591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf801ee-9057-492a-8888-cd192cb10821 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:30.525548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 650/1301] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 15:04:30 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:04:32.683955 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbae53-4240-4536-a198-327445fb76fc None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:32.684793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbae53-4240-4536-a198-327445fb76fc None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:32.684793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbae53-4240-4536-a198-327445fb76fc None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:32.687000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 652/1302] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:04:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:32.692520 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e72a7-8c71-4bfa-99c0-1f2e81ed9534 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:32.692968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e72a7-8c71-4bfa-99c0-1f2e81ed9534 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:32.693062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e72a7-8c71-4bfa-99c0-1f2e81ed9534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:32.711407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7f9e72a7-8c71-4bfa-99c0-1f2e81ed9534 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:32.712541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7f9e72a7-8c71-4bfa-99c0-1f2e81ed9534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:32.780289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 651/1303] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:04:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:32.803456 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbae53-4240-4536-a198-327445fb76fc None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:32.913919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:32.925368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbae53-4240-4536-a198-327445fb76fc None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:32.961306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c073872-53a0-4b2d-8a3e-d619d2c3a16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:32.962171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c073872-53a0-4b2d-8a3e-d619d2c3a16f None admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:32.962437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c073872-53a0-4b2d-8a3e-d619d2c3a16f None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:32.962649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c073872-53a0-4b2d-8a3e-d619d2c3a16f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:32.963303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c073872-53a0-4b2d-8a3e-d619d2c3a16f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:32.964726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c073872-53a0-4b2d-8a3e-d619d2c3a16f None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application [None req-0c073872-53a0-4b2d-8a3e-d619d2c3a16f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:32.976703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:32.977907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application with Lock( May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: ERROR keystone.server.flask.application May 25 15:04:32.979110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 653/1304] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 15:04:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:32.984712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e72a7-8c71-4bfa-99c0-1f2e81ed9534 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:33.064292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:33.088450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e72a7-8c71-4bfa-99c0-1f2e81ed9534 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:33.123923 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b851c0-ed83-4a3c-add9-4b6ad3e610d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:33.124580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b851c0-ed83-4a3c-add9-4b6ad3e610d7 None admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:33.124870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b851c0-ed83-4a3c-add9-4b6ad3e610d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:33.125149 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b851c0-ed83-4a3c-add9-4b6ad3e610d7 None admin] PATH_INFO: `/v3/services` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:33.125963 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b851c0-ed83-4a3c-add9-4b6ad3e610d7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:33.126280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b851c0-ed83-4a3c-add9-4b6ad3e610d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:33.127670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b851c0-ed83-4a3c-add9-4b6ad3e610d7 None admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:33.132977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 652/1305] 10.222.0.24 () {56 vars in 1116 bytes} [Wed May 25 15:04:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:33.141773 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c073872-53a0-4b2d-8a3e-d619d2c3a16f None admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:33.249023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c073872-53a0-4b2d-8a3e-d619d2c3a16f None admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:33.288830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c175c9-4ce3-4376-a7d2-8288f0b52232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:33.289870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c175c9-4ce3-4376-a7d2-8288f0b52232 None admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:33.290366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c175c9-4ce3-4376-a7d2-8288f0b52232 None admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:33.290829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c175c9-4ce3-4376-a7d2-8288f0b52232 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:33.291972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c175c9-4ce3-4376-a7d2-8288f0b52232 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:33.293977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c175c9-4ce3-4376-a7d2-8288f0b52232 None admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:33.325082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 654/1306] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 15:04:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:43.129820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=30 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:43.318692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:36.942795 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3fa12-f6f7-48dc-87c3-e5d3153612b4 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:36.943305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3fa12-f6f7-48dc-87c3-e5d3153612b4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:36.943305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3fa12-f6f7-48dc-87c3-e5d3153612b4 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:36.944965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 653/1307] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:05:36.949883 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17635b1-9615-464c-acaf-d573e808e1d6 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:36.950381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17635b1-9615-464c-acaf-d573e808e1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:36.950680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17635b1-9615-464c-acaf-d573e808e1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:37.082043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-a17635b1-9615-464c-acaf-d573e808e1d6 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:37.083681 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-a17635b1-9615-464c-acaf-d573e808e1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:37.210028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 655/1308] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:37.258778 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18028626-a8f5-49e4-933b-bea21531314e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:37.259752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18028626-a8f5-49e4-933b-bea21531314e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:37.260193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18028626-a8f5-49e4-933b-bea21531314e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:37.262469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 654/1309] 10.222.0.24 () {54 vars in 964 bytes} [Wed May 25 15:05:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:05:37.268838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0608a-3071-4991-aeb2-93cabe0e7943 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:37.269381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0608a-3071-4991-aeb2-93cabe0e7943 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:37.269762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0608a-3071-4991-aeb2-93cabe0e7943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:37.353132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-a8a0608a-3071-4991-aeb2-93cabe0e7943 None None] MFA Rules not processed for user `d4b24eb13be7443f9c24e55532ef95d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:37.354538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-a8a0608a-3071-4991-aeb2-93cabe0e7943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:37.376650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:37.446349 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 656/1310] 10.222.0.24 () {58 vars in 1061 bytes} [Wed May 25 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:37.455618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18028626-a8f5-49e4-933b-bea21531314e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:37.457620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-18028626-a8f5-49e4-933b-bea21531314e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:37.579171 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18028626-a8f5-49e4-933b-bea21531314e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:37.660654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4c2e0-bc20-48e9-b90a-53aa4d7742fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:37.661506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4c2e0-bc20-48e9-b90a-53aa4d7742fa service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:37.661891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4c2e0-bc20-48e9-b90a-53aa4d7742fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:37.662268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4c2e0-bc20-48e9-b90a-53aa4d7742fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:37.664066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7ff4c2e0-bc20-48e9-b90a-53aa4d7742fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:37.720866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:37.780999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4c2e0-bc20-48e9-b90a-53aa4d7742fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:37.782597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4c2e0-bc20-48e9-b90a-53aa4d7742fa service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:37.801859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 655/1311] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:40.297750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc4654-02cc-4251-8681-29dcb4a35519 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:40.298333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc4654-02cc-4251-8681-29dcb4a35519 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:40.298333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc4654-02cc-4251-8681-29dcb4a35519 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:40.299750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 657/1312] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:05:40.305642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f1392-aae3-466c-a701-2473c2af6f38 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:40.306206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f1392-aae3-466c-a701-2473c2af6f38 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:40.306307 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f1392-aae3-466c-a701-2473c2af6f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:40.405639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-640f1392-aae3-466c-a701-2473c2af6f38 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:40.406925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-640f1392-aae3-466c-a701-2473c2af6f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:40.522680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 656/1313] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:40.561106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc4654-02cc-4251-8681-29dcb4a35519 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:40.562759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-26fc4654-02cc-4251-8681-29dcb4a35519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:40.676920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc4654-02cc-4251-8681-29dcb4a35519 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:40.752801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:40.755691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c128-cdf3-4626-acb3-fee7d0d37546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:40.756487 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c128-cdf3-4626-acb3-fee7d0d37546 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:40.756779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c128-cdf3-4626-acb3-fee7d0d37546 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:40.757062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c128-cdf3-4626-acb3-fee7d0d37546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:40.759155 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-f4d4c128-cdf3-4626-acb3-fee7d0d37546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:40.877425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c128-cdf3-4626-acb3-fee7d0d37546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:40.878998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c128-cdf3-4626-acb3-fee7d0d37546 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:40.898606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 658/1314] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:43.432498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6082a-5710-47dd-83a7-cd967a816329 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:43.433720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6082a-5710-47dd-83a7-cd967a816329 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:43.433720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6082a-5710-47dd-83a7-cd967a816329 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:43.435746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 657/1315] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:05:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:05:43.443749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f437eb5-b5ab-4c21-b207-061f1a25f2db None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:43.444213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f437eb5-b5ab-4c21-b207-061f1a25f2db None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:43.444310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f437eb5-b5ab-4c21-b207-061f1a25f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:43.511207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-4f437eb5-b5ab-4c21-b207-061f1a25f2db None None] MFA Rules not processed for user `cf9d84554d9c4cf2a39183e67800c82b`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:43.512426 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-4f437eb5-b5ab-4c21-b207-061f1a25f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:43.567377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:43.619004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 659/1316] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:05:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:43.659453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6082a-5710-47dd-83a7-cd967a816329 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:43.661028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e4b6082a-5710-47dd-83a7-cd967a816329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:43.671614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:43.773253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6082a-5710-47dd-83a7-cd967a816329 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:43.850198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3603b0e-56d7-401e-97e2-1b6568ed25ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:43.850840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3603b0e-56d7-401e-97e2-1b6568ed25ac service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:43.851119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3603b0e-56d7-401e-97e2-1b6568ed25ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:43.851392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3603b0e-56d7-401e-97e2-1b6568ed25ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:43.853048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c3603b0e-56d7-401e-97e2-1b6568ed25ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:43.920268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:43.973506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3603b0e-56d7-401e-97e2-1b6568ed25ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:43.974939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3603b0e-56d7-401e-97e2-1b6568ed25ac service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:43.993269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 658/1317] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:05:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:05:46.838073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9cab6-c0c8-47fc-8d38-cf72173bfb5d None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:46.838914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9cab6-c0c8-47fc-8d38-cf72173bfb5d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:46.839030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9cab6-c0c8-47fc-8d38-cf72173bfb5d None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:46.841180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 660/1318] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:05:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:05:46.848432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a978bbb-925b-4b4e-960d-408f49f77d34 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:46.849468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a978bbb-925b-4b4e-960d-408f49f77d34 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:46.849468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a978bbb-925b-4b4e-960d-408f49f77d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:46.924565 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8a978bbb-925b-4b4e-960d-408f49f77d34 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:46.925774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8a978bbb-925b-4b4e-960d-408f49f77d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:47.023890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 659/1319] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:05:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:47.084879 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288146-270e-4e66-b1fb-01dbf597454f None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:47.085173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288146-270e-4e66-b1fb-01dbf597454f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:47.085521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288146-270e-4e66-b1fb-01dbf597454f None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:47.087015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 661/1320] 10.222.0.24 () {54 vars in 964 bytes} [Wed May 25 15:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:05:47.093268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3103d-fbc4-44f6-a298-8dc4db151453 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:47.093501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3103d-fbc4-44f6-a298-8dc4db151453 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:47.093777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3103d-fbc4-44f6-a298-8dc4db151453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:47.114807 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:47.170672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4bd3103d-fbc4-44f6-a298-8dc4db151453 None None] MFA Rules not processed for user `d4b24eb13be7443f9c24e55532ef95d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:47.171954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4bd3103d-fbc4-44f6-a298-8dc4db151453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:47.251768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 660/1321] 10.222.0.24 () {58 vars in 1061 bytes} [Wed May 25 15:05:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:05:47.261359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288146-270e-4e66-b1fb-01dbf597454f None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:47.262894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-c5288146-270e-4e66-b1fb-01dbf597454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:47.382014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288146-270e-4e66-b1fb-01dbf597454f None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:47.456991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850f2bd-6161-48a5-b025-76a30e004856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:47.457648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850f2bd-6161-48a5-b025-76a30e004856 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:47.457934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850f2bd-6161-48a5-b025-76a30e004856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:47.458198 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850f2bd-6161-48a5-b025-76a30e004856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:47.459900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-8850f2bd-6161-48a5-b025-76a30e004856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:47.467715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:47.569276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850f2bd-6161-48a5-b025-76a30e004856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:47.570709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850f2bd-6161-48a5-b025-76a30e004856 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:47.588729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 662/1322] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:05:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:50.962539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ae0d6-9121-4058-b784-05b2042a5158 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:50.963043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ae0d6-9121-4058-b784-05b2042a5158 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:50.963157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ae0d6-9121-4058-b784-05b2042a5158 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:50.964509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 661/1323] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:05:50.969981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d74d8-8b9c-419d-ac80-4183fc6ae395 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:50.970431 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d74d8-8b9c-419d-ac80-4183fc6ae395 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:50.970534 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d74d8-8b9c-419d-ac80-4183fc6ae395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:51.038482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-8b7d74d8-8b9c-419d-ac80-4183fc6ae395 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:51.039726 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-8b7d74d8-8b9c-419d-ac80-4183fc6ae395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:51.100703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:51.141162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 663/1324] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:51.176113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ae0d6-9121-4058-b784-05b2042a5158 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:51.177850 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c95ae0d6-9121-4058-b784-05b2042a5158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:51.288103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ae0d6-9121-4058-b784-05b2042a5158 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:51.301091 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:51.365788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d9be1-a78c-45be-b08d-6ebb9263ca74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:51.366453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d9be1-a78c-45be-b08d-6ebb9263ca74 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:51.366736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d9be1-a78c-45be-b08d-6ebb9263ca74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:51.366988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d9be1-a78c-45be-b08d-6ebb9263ca74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:51.368711 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ab5d9be1-a78c-45be-b08d-6ebb9263ca74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:51.482907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d9be1-a78c-45be-b08d-6ebb9263ca74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:51.484617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d9be1-a78c-45be-b08d-6ebb9263ca74 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:51.505946 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 662/1325] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:05:53.747884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54680e01-00e3-44ff-9fe8-d2f0f4f7825f None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:53.748438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54680e01-00e3-44ff-9fe8-d2f0f4f7825f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:53.748438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54680e01-00e3-44ff-9fe8-d2f0f4f7825f None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:53.749960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 664/1326] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:05:53.755016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aebc76-a0ca-48a2-92df-fa54d0940b1b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:53.755439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aebc76-a0ca-48a2-92df-fa54d0940b1b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:53.755590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aebc76-a0ca-48a2-92df-fa54d0940b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:53.805804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:53.825384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-04aebc76-a0ca-48a2-92df-fa54d0940b1b None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:53.826694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-04aebc76-a0ca-48a2-92df-fa54d0940b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:53.926910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 663/1327] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:53.962530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54680e01-00e3-44ff-9fe8-d2f0f4f7825f None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:53.964130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-54680e01-00e3-44ff-9fe8-d2f0f4f7825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:54.070393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54680e01-00e3-44ff-9fe8-d2f0f4f7825f None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:54.151191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc983d-516e-4b83-a550-c38c17a14056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:54.151881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc983d-516e-4b83-a550-c38c17a14056 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:54.152165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc983d-516e-4b83-a550-c38c17a14056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:54.152442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc983d-516e-4b83-a550-c38c17a14056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:54.154085 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-c3cc983d-516e-4b83-a550-c38c17a14056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:54.173566 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:54.272943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc983d-516e-4b83-a550-c38c17a14056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:54.274576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc983d-516e-4b83-a550-c38c17a14056 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:54.295490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 665/1328] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:05:56.525004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26aa56-a51c-4842-8d6e-797289f8ad67 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:56.525587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26aa56-a51c-4842-8d6e-797289f8ad67 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:56.525587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26aa56-a51c-4842-8d6e-797289f8ad67 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:56.526967 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 664/1329] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:05:56.532369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c099d-1524-4498-98bb-465989c4de90 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:56.532822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c099d-1524-4498-98bb-465989c4de90 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:56.532920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c099d-1524-4498-98bb-465989c4de90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:56.608240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-505c099d-1524-4498-98bb-465989c4de90 None None] MFA Rules not processed for user `cf9d84554d9c4cf2a39183e67800c82b`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:56.609481 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-505c099d-1524-4498-98bb-465989c4de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:56.675095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:56.711667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 666/1330] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:05:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:56.748146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26aa56-a51c-4842-8d6e-797289f8ad67 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:56.749724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8a26aa56-a51c-4842-8d6e-797289f8ad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:56.858998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26aa56-a51c-4842-8d6e-797289f8ad67 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:56.879713 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:56.936855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea61398-8190-4b93-a32f-1a50ac0af10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:56.937729 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea61398-8190-4b93-a32f-1a50ac0af10d service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:56.938301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea61398-8190-4b93-a32f-1a50ac0af10d service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:56.938958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea61398-8190-4b93-a32f-1a50ac0af10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:56.940548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6ea61398-8190-4b93-a32f-1a50ac0af10d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:57.055004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea61398-8190-4b93-a32f-1a50ac0af10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:57.056498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea61398-8190-4b93-a32f-1a50ac0af10d service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:57.074838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 665/1331] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:05:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:05:59.499445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9e517-1672-4a02-bcda-1a4fdb2abf4d None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:59.499970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9e517-1672-4a02-bcda-1a4fdb2abf4d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:59.500077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9e517-1672-4a02-bcda-1a4fdb2abf4d None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:59.501719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 667/1332] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:05:59.510867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d835-ca3f-4278-b83a-6a97856197f3 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:59.511339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d835-ca3f-4278-b83a-6a97856197f3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:59.511446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d835-ca3f-4278-b83a-6a97856197f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:59.589014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:59.592487 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5933d835-ca3f-4278-b83a-6a97856197f3 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:59.594184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5933d835-ca3f-4278-b83a-6a97856197f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:59.693431 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 666/1333] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:05:59.728852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9e517-1672-4a02-bcda-1a4fdb2abf4d None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:59.730552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-23e9e517-1672-4a02-bcda-1a4fdb2abf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:59.857030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9e517-1672-4a02-bcda-1a4fdb2abf4d None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:59.935306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e03b3-5043-4172-a039-c2f9f2a6628b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:59.935971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e03b3-5043-4172-a039-c2f9f2a6628b service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:59.936276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e03b3-5043-4172-a039-c2f9f2a6628b service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:59.936545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e03b3-5043-4172-a039-c2f9f2a6628b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:59.938178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-5b5e03b3-5043-4172-a039-c2f9f2a6628b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:59.966924 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:00.055499 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e03b3-5043-4172-a039-c2f9f2a6628b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:00.056996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e03b3-5043-4172-a039-c2f9f2a6628b service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:00.079693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 668/1334] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:02.343492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a988a71-0b82-4269-a4ca-e245a188094f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:02.344140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a988a71-0b82-4269-a4ca-e245a188094f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:02.344140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a988a71-0b82-4269-a4ca-e245a188094f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:02.345485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 667/1335] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:02.351842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4755913-2cc2-448f-a7aa-fbddda9b8021 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:02.352581 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4755913-2cc2-448f-a7aa-fbddda9b8021 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:02.352696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4755913-2cc2-448f-a7aa-fbddda9b8021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:02.429993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-a4755913-2cc2-448f-a7aa-fbddda9b8021 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:02.431854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-a4755913-2cc2-448f-a7aa-fbddda9b8021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:02.513247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:02.542635 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 669/1336] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:02.584857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a988a71-0b82-4269-a4ca-e245a188094f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:02.586432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5a988a71-0b82-4269-a4ca-e245a188094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:02.701284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a988a71-0b82-4269-a4ca-e245a188094f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:02.730841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:02.782532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e3a03-ec97-4a69-9489-09241e43850f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:02.783159 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e3a03-ec97-4a69-9489-09241e43850f service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:02.783461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e3a03-ec97-4a69-9489-09241e43850f service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:02.783771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e3a03-ec97-4a69-9489-09241e43850f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:02.785410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5b0e3a03-ec97-4a69-9489-09241e43850f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:02.898685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e3a03-ec97-4a69-9489-09241e43850f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:02.900146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e3a03-ec97-4a69-9489-09241e43850f service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:02.923060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 668/1337] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:05.583283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15d214-8afb-46b7-8be1-1e58b5e7b56f None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:05.583914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15d214-8afb-46b7-8be1-1e58b5e7b56f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:05.584016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15d214-8afb-46b7-8be1-1e58b5e7b56f None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:05.585442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 670/1338] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:05.591788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644a031-4dd1-41b2-8449-a28a0712dad8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:05.592536 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644a031-4dd1-41b2-8449-a28a0712dad8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:05.592709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644a031-4dd1-41b2-8449-a28a0712dad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:05.673112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1644a031-4dd1-41b2-8449-a28a0712dad8 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:05.674374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1644a031-4dd1-41b2-8449-a28a0712dad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:05.682920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:05.777943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 669/1339] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:05.820762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15d214-8afb-46b7-8be1-1e58b5e7b56f None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:05.822306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-ec15d214-8afb-46b7-8be1-1e58b5e7b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:05.935161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15d214-8afb-46b7-8be1-1e58b5e7b56f None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:06.012372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876d7ce-f28d-4696-8d17-c8252235d6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:06.013023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d7ce-f28d-4696-8d17-c8252235d6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:06.013310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d7ce-f28d-4696-8d17-c8252235d6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:06.013595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d7ce-f28d-4696-8d17-c8252235d6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:06.015286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-0876d7ce-f28d-4696-8d17-c8252235d6c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:06.053952 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:06.149611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876d7ce-f28d-4696-8d17-c8252235d6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:06.151073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876d7ce-f28d-4696-8d17-c8252235d6c7 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:06.171453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 671/1340] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:10.484406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852567e3-57d8-45fe-a15e-256964c283fc None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:10.484995 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852567e3-57d8-45fe-a15e-256964c283fc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:10.484995 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852567e3-57d8-45fe-a15e-256964c283fc None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:10.486322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 670/1341] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:10.491840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddafef-6640-44db-ae51-ea436e80dbb8 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:10.492291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddafef-6640-44db-ae51-ea436e80dbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:10.492395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddafef-6640-44db-ae51-ea436e80dbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:10.567455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-3bddafef-6640-44db-ae51-ea436e80dbb8 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:10.569037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-3bddafef-6640-44db-ae51-ea436e80dbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:10.668048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:10.682075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 672/1342] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:10.723167 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852567e3-57d8-45fe-a15e-256964c283fc None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:10.725910 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-852567e3-57d8-45fe-a15e-256964c283fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:10.826627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852567e3-57d8-45fe-a15e-256964c283fc None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:10.830353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4c544-9b56-46b2-ba05-7bfeb0de3d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:10.831009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4c544-9b56-46b2-ba05-7bfeb0de3d93 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:10.831300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4c544-9b56-46b2-ba05-7bfeb0de3d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:10.831587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4c544-9b56-46b2-ba05-7bfeb0de3d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:10.841604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4c544-9b56-46b2-ba05-7bfeb0de3d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:10.843086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4c544-9b56-46b2-ba05-7bfeb0de3d93 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:10.853039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 671/1343] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:13.655090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa95ce-8a79-4f28-b3ad-4fb51e968f08 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:13.655761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa95ce-8a79-4f28-b3ad-4fb51e968f08 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:13.655761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa95ce-8a79-4f28-b3ad-4fb51e968f08 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:13.657109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 673/1344] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:13.662742 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e845b-75a9-4703-bf8e-936a7a6f3899 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:13.663589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e845b-75a9-4703-bf8e-936a7a6f3899 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:13.663896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e845b-75a9-4703-bf8e-936a7a6f3899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:13.692340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8f9e845b-75a9-4703-bf8e-936a7a6f3899 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:13.693516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8f9e845b-75a9-4703-bf8e-936a7a6f3899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:13.722244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:13.776244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 672/1345] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:13.813169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa95ce-8a79-4f28-b3ad-4fb51e968f08 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:13.824947 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa95ce-8a79-4f28-b3ad-4fb51e968f08 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:13.828691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d21ee5-6e87-49a7-a90d-c6ef7c05b5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:13.829344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d21ee5-6e87-49a7-a90d-c6ef7c05b5ec service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:13.829633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d21ee5-6e87-49a7-a90d-c6ef7c05b5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:13.829915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d21ee5-6e87-49a7-a90d-c6ef7c05b5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:13.840173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d21ee5-6e87-49a7-a90d-c6ef7c05b5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:13.841624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d21ee5-6e87-49a7-a90d-c6ef7c05b5ec service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:13.853006 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 674/1346] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:17.968231 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79401878-0dd3-4f40-89c0-42e8fda5c561 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:17.968775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79401878-0dd3-4f40-89c0-42e8fda5c561 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:17.968775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79401878-0dd3-4f40-89c0-42e8fda5c561 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:17.970094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 673/1347] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:17.975456 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa17f-b160-4448-b163-cf08bcfeccc7 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:17.975956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa17f-b160-4448-b163-cf08bcfeccc7 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:17.976188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa17f-b160-4448-b163-cf08bcfeccc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:17.995587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-67ffa17f-b160-4448-b163-cf08bcfeccc7 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:17.996824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-67ffa17f-b160-4448-b163-cf08bcfeccc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:18.006319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 675/1348] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:18.054060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79401878-0dd3-4f40-89c0-42e8fda5c561 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:18.056016 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-79401878-0dd3-4f40-89c0-42e8fda5c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:18.070675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79401878-0dd3-4f40-89c0-42e8fda5c561 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:18.074678 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7721bc4-bd24-4e11-8fa7-341f9b60d9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:18.075330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7721bc4-bd24-4e11-8fa7-341f9b60d9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:18.075619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7721bc4-bd24-4e11-8fa7-341f9b60d9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:18.075929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7721bc4-bd24-4e11-8fa7-341f9b60d9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:18.085942 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7721bc4-bd24-4e11-8fa7-341f9b60d9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:18.087386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7721bc4-bd24-4e11-8fa7-341f9b60d9e5 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:18.097265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 674/1349] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:23.455086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eb07d-c064-4fbb-8ec3-e64d0d8bd47e None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:23.455514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eb07d-c064-4fbb-8ec3-e64d0d8bd47e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:23.455663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eb07d-c064-4fbb-8ec3-e64d0d8bd47e None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:23.458671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 676/1350] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 15:06:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:23.465714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c752f0-fb9f-4ccf-9a30-85741f9d1b9d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:23.466216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c752f0-fb9f-4ccf-9a30-85741f9d1b9d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:23.466425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c752f0-fb9f-4ccf-9a30-85741f9d1b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:23.547290 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-68c752f0-fb9f-4ccf-9a30-85741f9d1b9d None None] MFA Rules not processed for user `3b717fe1f83743eabe4be630ddbe508c`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:23.549173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-68c752f0-fb9f-4ccf-9a30-85741f9d1b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:23.658677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 675/1351] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 15:06:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:27.694629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e99439-cbcc-4395-bd35-5116310704ed None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:27.695158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e99439-cbcc-4395-bd35-5116310704ed None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:27.695158 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e99439-cbcc-4395-bd35-5116310704ed None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:27.696810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 677/1352] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 15:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:27.701999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca2b13-8811-4d94-89dc-a64055929305 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:27.702454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca2b13-8811-4d94-89dc-a64055929305 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:27.702551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca2b13-8811-4d94-89dc-a64055929305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:27.722244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-77ca2b13-8811-4d94-89dc-a64055929305 None None] MFA Rules not processed for user `3b717fe1f83743eabe4be630ddbe508c`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:27.723423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-77ca2b13-8811-4d94-89dc-a64055929305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:27.734299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 676/1353] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 15:06:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:27.989937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=13 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:29.441505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fbe40-236a-4955-a204-3f5237e16f07 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:29.442347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fbe40-236a-4955-a204-3f5237e16f07 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:29.442347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fbe40-236a-4955-a204-3f5237e16f07 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:29.443424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 678/1354] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 15:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:29.448949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ba1f0-1de8-4ecd-8676-a3597cf2a318 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:29.449434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ba1f0-1de8-4ecd-8676-a3597cf2a318 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:29.451296 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ba1f0-1de8-4ecd-8676-a3597cf2a318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:29.470170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-166ba1f0-1de8-4ecd-8676-a3597cf2a318 None None] MFA Rules not processed for user `3b717fe1f83743eabe4be630ddbe508c`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:29.471376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-166ba1f0-1de8-4ecd-8676-a3597cf2a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:29.480820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 677/1355] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 15:06:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:33.241862 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126d83-8086-4bd4-8ee2-583d5ede7006 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:33.242600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126d83-8086-4bd4-8ee2-583d5ede7006 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:33.242600 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126d83-8086-4bd4-8ee2-583d5ede7006 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:33.243640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 679/1356] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:33.249161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a52df-c653-4898-9ae4-7587d9142427 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:33.249639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a52df-c653-4898-9ae4-7587d9142427 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:33.249738 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a52df-c653-4898-9ae4-7587d9142427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:33.268207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-794a52df-c653-4898-9ae4-7587d9142427 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:33.269395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-794a52df-c653-4898-9ae4-7587d9142427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:33.277302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 678/1357] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:33.335330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdf27b-a383-4db0-b693-0ecbab1700d9 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:33.335639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdf27b-a383-4db0-b693-0ecbab1700d9 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:33.335936 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdf27b-a383-4db0-b693-0ecbab1700d9 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:33.337993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 680/1358] 10.222.0.24 () {54 vars in 961 bytes} [Wed May 25 15:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:33.346796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5db8b5-1ce6-4985-a59c-37a144ec418b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:33.347284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5db8b5-1ce6-4985-a59c-37a144ec418b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:33.347977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5db8b5-1ce6-4985-a59c-37a144ec418b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:33.393373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:33.403172 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7c5db8b5-1ce6-4985-a59c-37a144ec418b None None] MFA Rules not processed for user `f553cee02ab345dabbef807bfe85544a`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:33.404423 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7c5db8b5-1ce6-4985-a59c-37a144ec418b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:33.497267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 679/1359] 10.222.0.24 () {58 vars in 1058 bytes} [Wed May 25 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:33.505712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdf27b-a383-4db0-b693-0ecbab1700d9 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:33.520139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdf27b-a383-4db0-b693-0ecbab1700d9 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:33.525945 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9704dd-adae-4926-ac3f-d98015d37f9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:33.526580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9704dd-adae-4926-ac3f-d98015d37f9e service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:33.526861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9704dd-adae-4926-ac3f-d98015d37f9e service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:33.527136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9704dd-adae-4926-ac3f-d98015d37f9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:33.535827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9704dd-adae-4926-ac3f-d98015d37f9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:33.537433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9704dd-adae-4926-ac3f-d98015d37f9e service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:33.546971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 681/1360] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:06:35.960982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb4eb9-7866-4785-9f03-485f5b058ab4 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:35.961623 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb4eb9-7866-4785-9f03-485f5b058ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:35.961623 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb4eb9-7866-4785-9f03-485f5b058ab4 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:35.963104 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 680/1361] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:35.968522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb208141-607a-470d-ab05-5fabf7a8feae None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:35.968975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb208141-607a-470d-ab05-5fabf7a8feae None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:35.969073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb208141-607a-470d-ab05-5fabf7a8feae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:35.987754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-eb208141-607a-470d-ab05-5fabf7a8feae None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:35.988975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-eb208141-607a-470d-ab05-5fabf7a8feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:35.997673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 682/1362] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:36.042183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb4eb9-7866-4785-9f03-485f5b058ab4 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:36.058112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb4eb9-7866-4785-9f03-485f5b058ab4 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:36.064439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d31736-3f37-4e41-acad-a06d35b5183c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:36.065147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d31736-3f37-4e41-acad-a06d35b5183c service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:36.065467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d31736-3f37-4e41-acad-a06d35b5183c service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:36.065779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d31736-3f37-4e41-acad-a06d35b5183c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:36.075154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d31736-3f37-4e41-acad-a06d35b5183c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:36.077126 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d31736-3f37-4e41-acad-a06d35b5183c service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:36.087618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 681/1363] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:38.643636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238961e3-a691-4485-aa46-6619239a7e30 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:38.644138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238961e3-a691-4485-aa46-6619239a7e30 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:38.644233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238961e3-a691-4485-aa46-6619239a7e30 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:38.645634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 683/1364] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:38.651053 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b8938-5149-42f1-8e0f-2c0a1200575c None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:38.651479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b8938-5149-42f1-8e0f-2c0a1200575c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:38.651780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b8938-5149-42f1-8e0f-2c0a1200575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:38.670404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5a5b8938-5149-42f1-8e0f-2c0a1200575c None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:38.671630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5a5b8938-5149-42f1-8e0f-2c0a1200575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:38.680150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 682/1365] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:06:38.726657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b6af4-0250-41a6-90de-b0a9c44d6d2a None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:38.726657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b6af4-0250-41a6-90de-b0a9c44d6d2a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:38.726880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b6af4-0250-41a6-90de-b0a9c44d6d2a None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:38.730372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 684/1366] 10.222.0.24 () {54 vars in 961 bytes} [Wed May 25 15:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:38.733793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd6ca-7321-4725-99bf-763469f06812 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:38.733973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd6ca-7321-4725-99bf-763469f06812 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:38.734254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd6ca-7321-4725-99bf-763469f06812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:38.753092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-cc0fd6ca-7321-4725-99bf-763469f06812 None None] MFA Rules not processed for user `f553cee02ab345dabbef807bfe85544a`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:38.754292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cc0fd6ca-7321-4725-99bf-763469f06812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:38.767468 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 683/1367] 10.222.0.24 () {58 vars in 1058 bytes} [Wed May 25 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:38.776761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b6af4-0250-41a6-90de-b0a9c44d6d2a None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:38.790977 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b6af4-0250-41a6-90de-b0a9c44d6d2a None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:38.796585 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe1a80-38c3-44a2-a03c-6274c8f6fbaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:38.797224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe1a80-38c3-44a2-a03c-6274c8f6fbaf service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:38.797508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe1a80-38c3-44a2-a03c-6274c8f6fbaf service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:38.797788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe1a80-38c3-44a2-a03c-6274c8f6fbaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:38.805752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe1a80-38c3-44a2-a03c-6274c8f6fbaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:38.807363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe1a80-38c3-44a2-a03c-6274c8f6fbaf service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:38.822363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 685/1368] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:41.102464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2418371-7013-4d3f-a314-c3db64e53de0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:41.103077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2418371-7013-4d3f-a314-c3db64e53de0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:41.103077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2418371-7013-4d3f-a314-c3db64e53de0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:41.104404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 684/1369] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:41.109992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12a01e-10a5-40c7-8db2-a3674ae5900a None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:41.110459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12a01e-10a5-40c7-8db2-a3674ae5900a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:41.111339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12a01e-10a5-40c7-8db2-a3674ae5900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:41.130045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-1e12a01e-10a5-40c7-8db2-a3674ae5900a None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:41.131241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-1e12a01e-10a5-40c7-8db2-a3674ae5900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:41.139972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 686/1370] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:41.183131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2418371-7013-4d3f-a314-c3db64e53de0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:41.197914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2418371-7013-4d3f-a314-c3db64e53de0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:41.203490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a0c14-10f2-4e55-8040-14ffacf6514c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:41.204178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a0c14-10f2-4e55-8040-14ffacf6514c service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:41.204463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a0c14-10f2-4e55-8040-14ffacf6514c service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:41.204754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a0c14-10f2-4e55-8040-14ffacf6514c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:41.213445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a0c14-10f2-4e55-8040-14ffacf6514c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:41.214960 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a0c14-10f2-4e55-8040-14ffacf6514c service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:41.225114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 685/1371] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:41.537325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ebd5-dc23-4b6c-87ca-ab61a04db382 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:41.537619 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ebd5-dc23-4b6c-87ca-ab61a04db382 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:41.537888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ebd5-dc23-4b6c-87ca-ab61a04db382 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:41.539280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 687/1372] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:41.545379 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9347a34-81ee-4683-a443-50cdeb93dd3b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:41.548052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9347a34-81ee-4683-a443-50cdeb93dd3b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:41.548385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9347a34-81ee-4683-a443-50cdeb93dd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:41.568848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a9347a34-81ee-4683-a443-50cdeb93dd3b None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:41.570083 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a9347a34-81ee-4683-a443-50cdeb93dd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:41.584343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 686/1373] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:41.885987 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e1e7a-eddd-42ef-b1b8-da9877a919af None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:41.886275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e1e7a-eddd-42ef-b1b8-da9877a919af None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:41.886553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e1e7a-eddd-42ef-b1b8-da9877a919af None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:41.888078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 688/1374] 10.222.0.24 () {54 vars in 963 bytes} [Wed May 25 15:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:41.894154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674ae7-b493-4b91-99e8-171524d5777a None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:41.894449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674ae7-b493-4b91-99e8-171524d5777a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:41.894730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674ae7-b493-4b91-99e8-171524d5777a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:41.944297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2c674ae7-b493-4b91-99e8-171524d5777a None None] MFA Rules not processed for user `49e5814865044696a7d0021d44629604`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:41.945498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2c674ae7-b493-4b91-99e8-171524d5777a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:42.008119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 687/1375] 10.222.0.24 () {58 vars in 1060 bytes} [Wed May 25 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:42.015825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e1e7a-eddd-42ef-b1b8-da9877a919af None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:42.026966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e1e7a-eddd-42ef-b1b8-da9877a919af None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:42.030542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc56bb-01a5-4eb2-b076-a66f9ae45f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49e5814865044696a7d0021d44629604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:42.031186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc56bb-01a5-4eb2-b076-a66f9ae45f9f service cinder] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:42.031453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc56bb-01a5-4eb2-b076-a66f9ae45f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:42.031984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc56bb-01a5-4eb2-b076-a66f9ae45f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:42.041785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc56bb-01a5-4eb2-b076-a66f9ae45f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:42.043375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc56bb-01a5-4eb2-b076-a66f9ae45f9f service cinder] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:42.059857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 689/1376] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:43.474891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4611707-c592-4ecf-9e0d-c33c686a9e00 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:43.475470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4611707-c592-4ecf-9e0d-c33c686a9e00 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:43.475470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4611707-c592-4ecf-9e0d-c33c686a9e00 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:43.476882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 688/1377] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:43.485243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ea01-a76d-4ef6-8452-fd1f01b96883 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:43.485701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ea01-a76d-4ef6-8452-fd1f01b96883 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:43.485801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ea01-a76d-4ef6-8452-fd1f01b96883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:43.503768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-5443ea01-a76d-4ef6-8452-fd1f01b96883 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:43.505086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-5443ea01-a76d-4ef6-8452-fd1f01b96883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:43.513323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 690/1378] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:43.558827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4611707-c592-4ecf-9e0d-c33c686a9e00 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:43.575125 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4611707-c592-4ecf-9e0d-c33c686a9e00 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:43.581293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a2da9-9f1e-46e6-a13a-45fd8b57eb59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:43.581970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a2da9-9f1e-46e6-a13a-45fd8b57eb59 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:43.582256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a2da9-9f1e-46e6-a13a-45fd8b57eb59 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:43.582540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a2da9-9f1e-46e6-a13a-45fd8b57eb59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:43.592005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a2da9-9f1e-46e6-a13a-45fd8b57eb59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:43.593760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a2da9-9f1e-46e6-a13a-45fd8b57eb59 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:43.598193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:43.605931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 689/1379] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:45.845371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf5a64-850f-4818-bda4-91726d612dd7 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:45.846002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf5a64-850f-4818-bda4-91726d612dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:45.846002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf5a64-850f-4818-bda4-91726d612dd7 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:45.847251 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 691/1380] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:45.852964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712cd6f-fd24-4795-bdbf-79c1e528f9b2 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:45.853449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712cd6f-fd24-4795-bdbf-79c1e528f9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:45.853546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712cd6f-fd24-4795-bdbf-79c1e528f9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:45.872330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a712cd6f-fd24-4795-bdbf-79c1e528f9b2 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:45.873506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a712cd6f-fd24-4795-bdbf-79c1e528f9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:45.882263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 690/1381] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:06:45.925989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf5a64-850f-4818-bda4-91726d612dd7 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:45.941561 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf5a64-850f-4818-bda4-91726d612dd7 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:45.947154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dfd42-460e-42a5-9adb-887e3618c8ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:45.947825 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dfd42-460e-42a5-9adb-887e3618c8ec service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:45.948113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dfd42-460e-42a5-9adb-887e3618c8ec service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:45.948575 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dfd42-460e-42a5-9adb-887e3618c8ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:45.958066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dfd42-460e-42a5-9adb-887e3618c8ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:45.959672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dfd42-460e-42a5-9adb-887e3618c8ec service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:45.969679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 692/1382] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:48.202824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f395d4-3564-4d2a-91a9-efdba0904fe1 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:48.203353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f395d4-3564-4d2a-91a9-efdba0904fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:48.203353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f395d4-3564-4d2a-91a9-efdba0904fe1 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:48.204870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 691/1383] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:48.210716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6951-d4d6-4ec2-9d6c-193003cb170a None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:48.211143 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6951-d4d6-4ec2-9d6c-193003cb170a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:48.211396 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6951-d4d6-4ec2-9d6c-193003cb170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:48.229894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-529a6951-d4d6-4ec2-9d6c-193003cb170a None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:48.231180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-529a6951-d4d6-4ec2-9d6c-193003cb170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:48.239219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 693/1384] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:48.283404 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f395d4-3564-4d2a-91a9-efdba0904fe1 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:48.302444 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f395d4-3564-4d2a-91a9-efdba0904fe1 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:48.308052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5fdfe-d820-4c4b-99a6-3e6ccf0c83df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:48.308891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5fdfe-d820-4c4b-99a6-3e6ccf0c83df service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:48.309790 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5fdfe-d820-4c4b-99a6-3e6ccf0c83df service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:48.310252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5fdfe-d820-4c4b-99a6-3e6ccf0c83df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:48.319004 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5fdfe-d820-4c4b-99a6-3e6ccf0c83df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:48.320984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5fdfe-d820-4c4b-99a6-3e6ccf0c83df service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:48.331522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 692/1385] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:50.816737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e65a9-6f36-4739-aca4-34457796de2b None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:50.817352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e65a9-6f36-4739-aca4-34457796de2b None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:50.817352 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e65a9-6f36-4739-aca4-34457796de2b None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:50.818764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 694/1386] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:50.824270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08efba-ac32-46f9-b9d7-3b17b1218cc5 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:50.824718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08efba-ac32-46f9-b9d7-3b17b1218cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:50.824841 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08efba-ac32-46f9-b9d7-3b17b1218cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:50.844342 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2d08efba-ac32-46f9-b9d7-3b17b1218cc5 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:50.845834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2d08efba-ac32-46f9-b9d7-3b17b1218cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:50.855725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 693/1387] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:50.899431 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e65a9-6f36-4739-aca4-34457796de2b None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:50.915025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e65a9-6f36-4739-aca4-34457796de2b None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:50.921065 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10964a-25e7-4015-9f76-4479b8c88c33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:50.921712 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10964a-25e7-4015-9f76-4479b8c88c33 service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:50.922001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10964a-25e7-4015-9f76-4479b8c88c33 service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:50.922280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10964a-25e7-4015-9f76-4479b8c88c33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:50.930922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10964a-25e7-4015-9f76-4479b8c88c33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:50.932519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10964a-25e7-4015-9f76-4479b8c88c33 service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:50.942485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 695/1388] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:53.186093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29007822-7618-499b-991b-93e5569f7070 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:53.186679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29007822-7618-499b-991b-93e5569f7070 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:53.186679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29007822-7618-499b-991b-93e5569f7070 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:53.188213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 694/1389] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:53.194365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0985d7-5095-43a7-a603-1f5a92f5df92 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:53.194779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0985d7-5095-43a7-a603-1f5a92f5df92 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:53.195180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0985d7-5095-43a7-a603-1f5a92f5df92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:53.218829 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-fc0985d7-5095-43a7-a603-1f5a92f5df92 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:53.220443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-fc0985d7-5095-43a7-a603-1f5a92f5df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:53.231246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 696/1390] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:53.288005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29007822-7618-499b-991b-93e5569f7070 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:53.307132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29007822-7618-499b-991b-93e5569f7070 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:53.316341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a513d-9a1c-4209-8d6d-3afb9f8e531d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:53.317195 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a513d-9a1c-4209-8d6d-3afb9f8e531d service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:53.317475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a513d-9a1c-4209-8d6d-3afb9f8e531d service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:53.317950 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a513d-9a1c-4209-8d6d-3afb9f8e531d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:53.328689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a513d-9a1c-4209-8d6d-3afb9f8e531d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:53.330283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a513d-9a1c-4209-8d6d-3afb9f8e531d service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:53.340018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 695/1391] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:55.790527 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d4ca4-29ec-4a27-a474-953de819e133 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:55.791127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d4ca4-29ec-4a27-a474-953de819e133 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:55.791127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d4ca4-29ec-4a27-a474-953de819e133 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:55.792575 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 697/1392] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:55.798802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55458e-3ec8-40d6-a1ab-2e9c94f1237b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:55.799542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55458e-3ec8-40d6-a1ab-2e9c94f1237b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:55.799542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55458e-3ec8-40d6-a1ab-2e9c94f1237b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:55.818650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2d55458e-3ec8-40d6-a1ab-2e9c94f1237b None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:55.819870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2d55458e-3ec8-40d6-a1ab-2e9c94f1237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:55.828294 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 696/1393] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:55.873252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d4ca4-29ec-4a27-a474-953de819e133 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:55.888555 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d4ca4-29ec-4a27-a474-953de819e133 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:55.894372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed64eb5-e2d7-4d3c-a78f-084c0a07ab3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:55.895024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed64eb5-e2d7-4d3c-a78f-084c0a07ab3a service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:55.895311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed64eb5-e2d7-4d3c-a78f-084c0a07ab3a service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:55.895587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed64eb5-e2d7-4d3c-a78f-084c0a07ab3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:55.904216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed64eb5-e2d7-4d3c-a78f-084c0a07ab3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:55.905872 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed64eb5-e2d7-4d3c-a78f-084c0a07ab3a service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:55.916037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 698/1394] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:57.805081 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21542-bd4f-44b7-aa2b-c03fc3d961a9 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:57.805705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21542-bd4f-44b7-aa2b-c03fc3d961a9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:57.805705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21542-bd4f-44b7-aa2b-c03fc3d961a9 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:57.807018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 697/1395] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:57.812636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0086ec-dcd7-40f4-b491-02c2669c2524 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:57.813118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0086ec-dcd7-40f4-b491-02c2669c2524 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:57.813217 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0086ec-dcd7-40f4-b491-02c2669c2524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:57.831370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-ca0086ec-dcd7-40f4-b491-02c2669c2524 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:57.832810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-ca0086ec-dcd7-40f4-b491-02c2669c2524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:57.841048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 699/1396] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:57.895380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd112385-156e-41bc-844f-7bb792afba63 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:57.895698 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd112385-156e-41bc-844f-7bb792afba63 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:57.895979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd112385-156e-41bc-844f-7bb792afba63 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:57.897362 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 698/1397] 10.222.0.24 () {54 vars in 962 bytes} [Wed May 25 15:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:57.902607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce977e-0fea-45a9-bbb9-bc6a52c406ec None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:57.902998 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce977e-0fea-45a9-bbb9-bc6a52c406ec None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:57.903345 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce977e-0fea-45a9-bbb9-bc6a52c406ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:57.956008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-ddce977e-0fea-45a9-bbb9-bc6a52c406ec None None] MFA Rules not processed for user `79f0aa2ddbcb494f8a5a53399793aa2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:57.957256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-ddce977e-0fea-45a9-bbb9-bc6a52c406ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:58.000221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=84 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:58.022359 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 700/1398] 10.222.0.24 () {58 vars in 1059 bytes} [Wed May 25 15:06:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:58.030255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd112385-156e-41bc-844f-7bb792afba63 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:58.041320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd112385-156e-41bc-844f-7bb792afba63 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:58.044990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf04f8-7466-409d-8fdb-f5f3e5276ac4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f0aa2ddbcb494f8a5a53399793aa2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:58.045630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf04f8-7466-409d-8fdb-f5f3e5276ac4 service glance] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:58.045954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf04f8-7466-409d-8fdb-f5f3e5276ac4 service glance] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:58.046236 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf04f8-7466-409d-8fdb-f5f3e5276ac4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:58.055594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf04f8-7466-409d-8fdb-f5f3e5276ac4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:58.057014 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf04f8-7466-409d-8fdb-f5f3e5276ac4 service glance] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:58.067052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 699/1399] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:58.148132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6bc5c-1108-4def-b93e-b2b8ec19cae9 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:58.148496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6bc5c-1108-4def-b93e-b2b8ec19cae9 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:58.148776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6bc5c-1108-4def-b93e-b2b8ec19cae9 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:58.150152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 701/1400] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:58.155584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc892b8-f9c4-41da-ab40-019bcbd97208 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:58.155930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc892b8-f9c4-41da-ab40-019bcbd97208 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:58.156215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc892b8-f9c4-41da-ab40-019bcbd97208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:58.174373 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ebc892b8-f9c4-41da-ab40-019bcbd97208 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:58.175586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ebc892b8-f9c4-41da-ab40-019bcbd97208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:58.184082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 700/1401] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:58.228445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6bc5c-1108-4def-b93e-b2b8ec19cae9 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:58.243307 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6bc5c-1108-4def-b93e-b2b8ec19cae9 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:58.249135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e4806-fcd0-4b6f-a833-5872576ebb2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:58.249781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e4806-fcd0-4b6f-a833-5872576ebb2e service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:58.250054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e4806-fcd0-4b6f-a833-5872576ebb2e service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:58.250336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e4806-fcd0-4b6f-a833-5872576ebb2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:58.260935 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e4806-fcd0-4b6f-a833-5872576ebb2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:58.262686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e4806-fcd0-4b6f-a833-5872576ebb2e service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:58.274179 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 702/1402] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:06:58.610649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8c30a-f0b1-419f-b64c-a4ce04b7ced5 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:58.610934 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8c30a-f0b1-419f-b64c-a4ce04b7ced5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:58.611891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8c30a-f0b1-419f-b64c-a4ce04b7ced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:58.670346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7fc8c30a-f0b1-419f-b64c-a4ce04b7ced5 None None] MFA Rules not processed for user `042393fa408b45208021befccd6bd800`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:58.671590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7fc8c30a-f0b1-419f-b64c-a4ce04b7ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:58.739618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 701/1403] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 15:06:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:58.780671 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece4180-def7-4706-9233-573eccf5015c None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:58.780954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece4180-def7-4706-9233-573eccf5015c None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:58.781226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece4180-def7-4706-9233-573eccf5015c None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:58.782586 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 703/1404] 10.222.0.24 () {54 vars in 942 bytes} [Wed May 25 15:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:58.789219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaf12f-2fd9-4487-9ee9-88c99f91d44f None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:58.789602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaf12f-2fd9-4487-9ee9-88c99f91d44f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:58.789957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaf12f-2fd9-4487-9ee9-88c99f91d44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:58.839490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7eeaf12f-2fd9-4487-9ee9-88c99f91d44f None None] MFA Rules not processed for user `1643cf33cd3b417bb2cd15b5503f7ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:58.840725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7eeaf12f-2fd9-4487-9ee9-88c99f91d44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:58.874452 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:58.913913 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 702/1405] 10.222.0.24 () {58 vars in 1039 bytes} [Wed May 25 15:06:58 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:06:58.924052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece4180-def7-4706-9233-573eccf5015c None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:58.938577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece4180-def7-4706-9233-573eccf5015c None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:58.943974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796febb5-caab-41fd-8158-52bb2cc43023 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1643cf33cd3b417bb2cd15b5503f7ffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:58.944625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796febb5-caab-41fd-8158-52bb2cc43023 service swift] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:58.944914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796febb5-caab-41fd-8158-52bb2cc43023 service swift] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:58.945196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796febb5-caab-41fd-8158-52bb2cc43023 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:58.953489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796febb5-caab-41fd-8158-52bb2cc43023 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:58.955119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796febb5-caab-41fd-8158-52bb2cc43023 service swift] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:58.964459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 704/1406] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 15:06:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:07:00.570917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb6d1-320c-45f7-bfc8-274ad0bcd76c None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:00.571459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb6d1-320c-45f7-bfc8-274ad0bcd76c None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:00.571945 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb6d1-320c-45f7-bfc8-274ad0bcd76c None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:00.574485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 703/1407] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:07:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:00.583084 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658437a2-93e5-49b3-a99f-1ce65b0b4fda None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:00.583706 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658437a2-93e5-49b3-a99f-1ce65b0b4fda None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:00.583706 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658437a2-93e5-49b3-a99f-1ce65b0b4fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:00.612048 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-658437a2-93e5-49b3-a99f-1ce65b0b4fda None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:00.614110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-658437a2-93e5-49b3-a99f-1ce65b0b4fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:00.630332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 705/1408] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:00.685754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afb6d1-320c-45f7-bfc8-274ad0bcd76c None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:00.708708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afb6d1-320c-45f7-bfc8-274ad0bcd76c None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:00.714866 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1e517-b868-47d2-bdc4-5ac0953062f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:00.715521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1e517-b868-47d2-bdc4-5ac0953062f3 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:00.715839 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1e517-b868-47d2-bdc4-5ac0953062f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:00.716123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1e517-b868-47d2-bdc4-5ac0953062f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:00.724582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1e517-b868-47d2-bdc4-5ac0953062f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:00.726164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1e517-b868-47d2-bdc4-5ac0953062f3 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:00.743970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 704/1409] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:10.605044 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=23 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:10.732843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=21 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:22.170965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f3f96-9c96-4b97-b95c-f93bdefa046e None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:22.171629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f3f96-9c96-4b97-b95c-f93bdefa046e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:22.171629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f3f96-9c96-4b97-b95c-f93bdefa046e None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:22.172948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 706/1410] 10.222.0.24 () {54 vars in 918 bytes} [Wed May 25 15:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:22.178490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2809c4-4d05-4ab5-913c-6df9d6765fc4 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:22.178931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2809c4-4d05-4ab5-913c-6df9d6765fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:22.179056 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2809c4-4d05-4ab5-913c-6df9d6765fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:22.198381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-ad2809c4-4d05-4ab5-913c-6df9d6765fc4 None None] MFA Rules not processed for user `3b717fe1f83743eabe4be630ddbe508c`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:22.199627 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ad2809c4-4d05-4ab5-913c-6df9d6765fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:22.209801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 705/1411] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 25 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:22.224098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b661bd-fe26-4d13-bb09-68b5dfee8f26 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:22.224395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b661bd-fe26-4d13-bb09-68b5dfee8f26 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:22.224680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b661bd-fe26-4d13-bb09-68b5dfee8f26 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:22.226037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 707/1412] 10.222.0.24 () {54 vars in 918 bytes} [Wed May 25 15:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:22.232323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508dd68-5bc5-4ced-87f6-d98fbbde0b38 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:22.232640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508dd68-5bc5-4ced-87f6-d98fbbde0b38 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:22.232894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508dd68-5bc5-4ced-87f6-d98fbbde0b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:22.251903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5508dd68-5bc5-4ced-87f6-d98fbbde0b38 None None] MFA Rules not processed for user `f553cee02ab345dabbef807bfe85544a`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:22.253098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5508dd68-5bc5-4ced-87f6-d98fbbde0b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:22.264027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 706/1413] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 25 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:07:24.954074 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c3dd-7e21-4181-b765-91e7d935baf0 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:24.954614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c3dd-7e21-4181-b765-91e7d935baf0 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:24.954614 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c3dd-7e21-4181-b765-91e7d935baf0 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:24.956051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:24.961351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99859-cf93-4865-9a03-3f406cec28eb None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:24.961793 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99859-cf93-4865-9a03-3f406cec28eb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:24.961920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99859-cf93-4865-9a03-3f406cec28eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:24.980875 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c5f99859-cf93-4865-9a03-3f406cec28eb None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:24.982073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c5f99859-cf93-4865-9a03-3f406cec28eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:24.991012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:25.038161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733c3dd-7e21-4181-b765-91e7d935baf0 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:25.053537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733c3dd-7e21-4181-b765-91e7d935baf0 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:25.059267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb98c7c-6d81-4d76-a6f2-b4cb98c1727e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:25.060242 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb98c7c-6d81-4d76-a6f2-b4cb98c1727e service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:25.060539 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb98c7c-6d81-4d76-a6f2-b4cb98c1727e service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:25.060817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb98c7c-6d81-4d76-a6f2-b4cb98c1727e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:25.069245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb98c7c-6d81-4d76-a6f2-b4cb98c1727e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:25.070833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb98c7c-6d81-4d76-a6f2-b4cb98c1727e service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:25.080515 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 709/1416] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:26.072502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db20060-7108-4363-8737-fa052b2b5980 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:26.073389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db20060-7108-4363-8737-fa052b2b5980 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:26.073389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db20060-7108-4363-8737-fa052b2b5980 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:26.075540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:07:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:26.081751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098889c7-d9ed-4686-958f-ab796d80ab08 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:26.082225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098889c7-d9ed-4686-958f-ab796d80ab08 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:26.082330 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098889c7-d9ed-4686-958f-ab796d80ab08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:26.111302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-098889c7-d9ed-4686-958f-ab796d80ab08 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:26.112550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-098889c7-d9ed-4686-958f-ab796d80ab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:26.121599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:26.307289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db20060-7108-4363-8737-fa052b2b5980 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:26.330986 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db20060-7108-4363-8737-fa052b2b5980 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:26.337580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079922c-d9ad-43c8-9e94-67eff7f91c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:26.338224 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079922c-d9ad-43c8-9e94-67eff7f91c42 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:26.338550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079922c-d9ad-43c8-9e94-67eff7f91c42 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:26.338828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079922c-d9ad-43c8-9e94-67eff7f91c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:26.347781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079922c-d9ad-43c8-9e94-67eff7f91c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:26.349414 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079922c-d9ad-43c8-9e94-67eff7f91c42 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:26.361925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 709/1419] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:27.286717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac311881-d83b-4159-b6d4-55c4a7626b5f None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:27.287343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac311881-d83b-4159-b6d4-55c4a7626b5f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:27.287343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac311881-d83b-4159-b6d4-55c4a7626b5f None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:27.288772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:27.297172 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f9f4c-151b-450d-9223-c5662917e94e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:27.297655 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f9f4c-151b-450d-9223-c5662917e94e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:27.297753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f9f4c-151b-450d-9223-c5662917e94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:27.321284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-275f9f4c-151b-450d-9223-c5662917e94e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:27.322536 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-275f9f4c-151b-450d-9223-c5662917e94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:27.332339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:27.483413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac311881-d83b-4159-b6d4-55c4a7626b5f None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:27.499648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac311881-d83b-4159-b6d4-55c4a7626b5f None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:27.505591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba7158-c45a-4325-9b04-4689b6977a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:27.506266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba7158-c45a-4325-9b04-4689b6977a6e service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:27.506546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba7158-c45a-4325-9b04-4689b6977a6e service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:27.506820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba7158-c45a-4325-9b04-4689b6977a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:27.515039 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba7158-c45a-4325-9b04-4689b6977a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:27.516769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba7158-c45a-4325-9b04-4689b6977a6e service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:27.528337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 712/1422] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:28.441692 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6d795-8ae0-4e80-ab4b-73a06e4c17ed None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:28.442339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6d795-8ae0-4e80-ab4b-73a06e4c17ed None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:28.442339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6d795-8ae0-4e80-ab4b-73a06e4c17ed None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:28.443802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:28.450073 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed93c7-bb75-4c68-895f-daf2506dd5c1 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:28.450810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed93c7-bb75-4c68-895f-daf2506dd5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:28.450970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed93c7-bb75-4c68-895f-daf2506dd5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:28.470101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-05ed93c7-bb75-4c68-895f-daf2506dd5c1 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:28.471276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-05ed93c7-bb75-4c68-895f-daf2506dd5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:28.479794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:28.627064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6d795-8ae0-4e80-ab4b-73a06e4c17ed None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:28.641900 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6d795-8ae0-4e80-ab4b-73a06e4c17ed None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:28.651247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f73e9-4030-4230-b68e-23dde1cd599f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:28.652305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f73e9-4030-4230-b68e-23dde1cd599f service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:28.652714 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f73e9-4030-4230-b68e-23dde1cd599f service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:28.653120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f73e9-4030-4230-b68e-23dde1cd599f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:28.663259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f73e9-4030-4230-b68e-23dde1cd599f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:28.664898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f73e9-4030-4230-b68e-23dde1cd599f service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:28.674482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 712/1425] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:29.597675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f96c7-85cf-4540-91e2-8242c92d5856 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:29.598287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f96c7-85cf-4540-91e2-8242c92d5856 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:29.598287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f96c7-85cf-4540-91e2-8242c92d5856 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:29.599654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:29.604801 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cc69e-dd63-4ba2-8f39-cd0c5195b556 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:29.605227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cc69e-dd63-4ba2-8f39-cd0c5195b556 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:29.605320 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cc69e-dd63-4ba2-8f39-cd0c5195b556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:29.625346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3b4cc69e-dd63-4ba2-8f39-cd0c5195b556 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:29.626551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3b4cc69e-dd63-4ba2-8f39-cd0c5195b556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:29.635658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:29.788006 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f96c7-85cf-4540-91e2-8242c92d5856 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:29.804652 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f96c7-85cf-4540-91e2-8242c92d5856 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:29.811437 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5756a8-6010-480b-9db9-b429113b7032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:29.812105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5756a8-6010-480b-9db9-b429113b7032 service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:29.812389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5756a8-6010-480b-9db9-b429113b7032 service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:29.812668 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5756a8-6010-480b-9db9-b429113b7032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:29.826580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5756a8-6010-480b-9db9-b429113b7032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:29.828513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5756a8-6010-480b-9db9-b429113b7032 service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:29.839245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 715/1428] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:30.680312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a0d23-8438-4903-ba43-88c54d10a04f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:30.681201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a0d23-8438-4903-ba43-88c54d10a04f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:30.681201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a0d23-8438-4903-ba43-88c54d10a04f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:30.683552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:07:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:30.689967 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1218e0-e2c3-485a-9cd9-e9a17b435cbf None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:30.690658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1218e0-e2c3-485a-9cd9-e9a17b435cbf None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:30.690807 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1218e0-e2c3-485a-9cd9-e9a17b435cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:30.714046 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-0e1218e0-e2c3-485a-9cd9-e9a17b435cbf None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:30.715164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-0e1218e0-e2c3-485a-9cd9-e9a17b435cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:30.722832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:30.874799 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a0d23-8438-4903-ba43-88c54d10a04f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:30.899475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a0d23-8438-4903-ba43-88c54d10a04f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:30.910106 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89a43e-51c1-46a4-9c30-3b7806bb5bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:30.910724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89a43e-51c1-46a4-9c30-3b7806bb5bf0 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:30.911010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89a43e-51c1-46a4-9c30-3b7806bb5bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:30.911291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89a43e-51c1-46a4-9c30-3b7806bb5bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:30.920406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89a43e-51c1-46a4-9c30-3b7806bb5bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:30.921993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89a43e-51c1-46a4-9c30-3b7806bb5bf0 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:30.931908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 715/1431] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:31.815854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf79c-d158-418e-9bd4-871faa19d65b None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:31.816730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf79c-d158-418e-9bd4-871faa19d65b None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:31.816730 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf79c-d158-418e-9bd4-871faa19d65b None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:31.818922 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:07:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:31.827519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99b3d-0433-47b5-82c9-41265bc18025 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:31.827983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99b3d-0433-47b5-82c9-41265bc18025 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:31.828124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99b3d-0433-47b5-82c9-41265bc18025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:31.853102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-cab99b3d-0433-47b5-82c9-41265bc18025 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:31.854309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cab99b3d-0433-47b5-82c9-41265bc18025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:31.863740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:32.014151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdf79c-d158-418e-9bd4-871faa19d65b None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:32.032800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdf79c-d158-418e-9bd4-871faa19d65b None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:32.039280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4d935-421e-415b-a51c-3a85bbfa44ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:32.039954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4d935-421e-415b-a51c-3a85bbfa44ae service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:32.040257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4d935-421e-415b-a51c-3a85bbfa44ae service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:32.040537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4d935-421e-415b-a51c-3a85bbfa44ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:32.049616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4d935-421e-415b-a51c-3a85bbfa44ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:32.051210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4d935-421e-415b-a51c-3a85bbfa44ae service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:32.061365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 718/1434] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:32.902300 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854f48-6eb3-4ce9-815c-b18fe91c78fa None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:32.902875 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854f48-6eb3-4ce9-815c-b18fe91c78fa None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:32.902875 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854f48-6eb3-4ce9-815c-b18fe91c78fa None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:32.904318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:32.910322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06121cd3-a913-447d-add7-673fd4ec9513 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:32.911068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06121cd3-a913-447d-add7-673fd4ec9513 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:32.911219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06121cd3-a913-447d-add7-673fd4ec9513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:32.933749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-06121cd3-a913-447d-add7-673fd4ec9513 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:32.934930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-06121cd3-a913-447d-add7-673fd4ec9513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:32.944049 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:33.095621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a854f48-6eb3-4ce9-815c-b18fe91c78fa None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:33.120333 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a854f48-6eb3-4ce9-815c-b18fe91c78fa None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:33.128328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909109-f615-4af2-9b35-e4eddb5284a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:33.128978 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909109-f615-4af2-9b35-e4eddb5284a1 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:33.129267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909109-f615-4af2-9b35-e4eddb5284a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:33.129530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909109-f615-4af2-9b35-e4eddb5284a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:33.138340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15909109-f615-4af2-9b35-e4eddb5284a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:33.139959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15909109-f615-4af2-9b35-e4eddb5284a1 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:33.149993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 718/1437] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:34.003869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d634e-eff0-4aad-bed3-33b2dcb6c26a None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:34.004465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d634e-eff0-4aad-bed3-33b2dcb6c26a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:34.004465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d634e-eff0-4aad-bed3-33b2dcb6c26a None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:34.006604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:07:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:34.014967 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff0216-c902-4cbc-b453-f6c35e29b1d8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:34.015771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff0216-c902-4cbc-b453-f6c35e29b1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:34.015949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff0216-c902-4cbc-b453-f6c35e29b1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:34.041447 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-88ff0216-c902-4cbc-b453-f6c35e29b1d8 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:34.042654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-88ff0216-c902-4cbc-b453-f6c35e29b1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:34.052537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:34.200549 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d634e-eff0-4aad-bed3-33b2dcb6c26a None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:34.217473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d634e-eff0-4aad-bed3-33b2dcb6c26a None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:34.223943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a276df2-6db2-4b3c-a3e3-d56445c522ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:34.224572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a276df2-6db2-4b3c-a3e3-d56445c522ea service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:34.224852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a276df2-6db2-4b3c-a3e3-d56445c522ea service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:34.225138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a276df2-6db2-4b3c-a3e3-d56445c522ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:34.233473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a276df2-6db2-4b3c-a3e3-d56445c522ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:34.235054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a276df2-6db2-4b3c-a3e3-d56445c522ea service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:34.244665 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 721/1440] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:36.345883 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d2fc2-3abe-448d-93ab-3747ee27b938 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:36.346501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d2fc2-3abe-448d-93ab-3747ee27b938 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:36.346501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d2fc2-3abe-448d-93ab-3747ee27b938 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:36.347902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:36.354530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20c403-095d-4034-98d1-ff34dbee1bf5 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:36.355263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20c403-095d-4034-98d1-ff34dbee1bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:36.355509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20c403-095d-4034-98d1-ff34dbee1bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:36.381776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-3d20c403-095d-4034-98d1-ff34dbee1bf5 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:36.382919 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-3d20c403-095d-4034-98d1-ff34dbee1bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:36.392901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:36.435827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d2fc2-3abe-448d-93ab-3747ee27b938 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:36.448136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d2fc2-3abe-448d-93ab-3747ee27b938 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:36.452736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498ba50-3de0-4cb9-9a9c-540d9c895332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:36.453389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498ba50-3de0-4cb9-9a9c-540d9c895332 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:36.453677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498ba50-3de0-4cb9-9a9c-540d9c895332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:36.453948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498ba50-3de0-4cb9-9a9c-540d9c895332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:36.464246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498ba50-3de0-4cb9-9a9c-540d9c895332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:36.465685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498ba50-3de0-4cb9-9a9c-540d9c895332 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:36.475411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 721/1443] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:38.898045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3b535-81f5-4563-8815-09ad33456ead None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:38.898921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3b535-81f5-4563-8815-09ad33456ead None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:38.898921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3b535-81f5-4563-8815-09ad33456ead None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:38.901221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:07:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:38.910194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51af831-c492-4da1-a227-a5b8b0a57702 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:38.910636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51af831-c492-4da1-a227-a5b8b0a57702 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:38.910832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51af831-c492-4da1-a227-a5b8b0a57702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:38.933107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a51af831-c492-4da1-a227-a5b8b0a57702 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:38.934328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a51af831-c492-4da1-a227-a5b8b0a57702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:38.943424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:38.981067 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3b535-81f5-4563-8815-09ad33456ead None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:38.993108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3b535-81f5-4563-8815-09ad33456ead None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:38.998617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acf1a4-e2e1-4d1d-bdd6-0b5ce1d17917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:38.999269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acf1a4-e2e1-4d1d-bdd6-0b5ce1d17917 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:38.999573 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acf1a4-e2e1-4d1d-bdd6-0b5ce1d17917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:38.999863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acf1a4-e2e1-4d1d-bdd6-0b5ce1d17917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:39.011061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acf1a4-e2e1-4d1d-bdd6-0b5ce1d17917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:39.012538 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acf1a4-e2e1-4d1d-bdd6-0b5ce1d17917 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:39.022422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 724/1446] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:41.552555 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2bab-4fd4-41f1-8717-1e7a7931f65f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:41.553496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2bab-4fd4-41f1-8717-1e7a7931f65f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:41.553496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2bab-4fd4-41f1-8717-1e7a7931f65f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:41.555661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:07:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:41.563987 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a81810-6050-4342-a414-4ef6ee8f04b0 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:41.564391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a81810-6050-4342-a414-4ef6ee8f04b0 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:41.564550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a81810-6050-4342-a414-4ef6ee8f04b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:41.583367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-e5a81810-6050-4342-a414-4ef6ee8f04b0 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:41.584582 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-e5a81810-6050-4342-a414-4ef6ee8f04b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:41.593734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:41.631495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c2bab-4fd4-41f1-8717-1e7a7931f65f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:41.645298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c2bab-4fd4-41f1-8717-1e7a7931f65f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:41.649506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d112883-219f-4294-af81-b5cd3b9acd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:41.650196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d112883-219f-4294-af81-b5cd3b9acd31 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:41.650478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d112883-219f-4294-af81-b5cd3b9acd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:41.650759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d112883-219f-4294-af81-b5cd3b9acd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:41.660319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d112883-219f-4294-af81-b5cd3b9acd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:41.661746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d112883-219f-4294-af81-b5cd3b9acd31 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:41.671366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 724/1449] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:44.011208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac90f4-3fd7-4fd8-913f-e921a42b4d3d None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:44.012257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac90f4-3fd7-4fd8-913f-e921a42b4d3d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:44.012257 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac90f4-3fd7-4fd8-913f-e921a42b4d3d None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:44.014439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:07:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:44.020896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74ade5-109b-4d7b-9d71-ad95daad4492 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:44.021375 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74ade5-109b-4d7b-9d71-ad95daad4492 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:44.021513 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74ade5-109b-4d7b-9d71-ad95daad4492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:44.049361 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7d74ade5-109b-4d7b-9d71-ad95daad4492 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:44.050592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7d74ade5-109b-4d7b-9d71-ad95daad4492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:44.059648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:44.098329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac90f4-3fd7-4fd8-913f-e921a42b4d3d None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:44.110022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac90f4-3fd7-4fd8-913f-e921a42b4d3d None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:44.114746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b1508-0ded-4e4a-9527-bb416ae2cd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:44.115381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b1508-0ded-4e4a-9527-bb416ae2cd28 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:44.115700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b1508-0ded-4e4a-9527-bb416ae2cd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:44.115968 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b1508-0ded-4e4a-9527-bb416ae2cd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:44.127180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b1508-0ded-4e4a-9527-bb416ae2cd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:44.128677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b1508-0ded-4e4a-9527-bb416ae2cd28 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:44.139332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 727/1452] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:07:46.474685 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb8ae4-b05f-4d1d-9bea-887319e154d0 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:46.475216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb8ae4-b05f-4d1d-9bea-887319e154d0 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:46.475216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb8ae4-b05f-4d1d-9bea-887319e154d0 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:46.476696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:46.482183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db00729-a85a-4a01-8491-8018c9663d48 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:46.482630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db00729-a85a-4a01-8491-8018c9663d48 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:46.482741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db00729-a85a-4a01-8491-8018c9663d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:46.502670 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-3db00729-a85a-4a01-8491-8018c9663d48 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:46.503907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-3db00729-a85a-4a01-8491-8018c9663d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:46.512182 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:46.549380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb8ae4-b05f-4d1d-9bea-887319e154d0 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:46.562353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb8ae4-b05f-4d1d-9bea-887319e154d0 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:46.566621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b8acd-2ef2-4c0a-802f-6e5bbe77c843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:46.567255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8acd-2ef2-4c0a-802f-6e5bbe77c843 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:46.567542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8acd-2ef2-4c0a-802f-6e5bbe77c843 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:46.567820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8acd-2ef2-4c0a-802f-6e5bbe77c843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:46.577833 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b8acd-2ef2-4c0a-802f-6e5bbe77c843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:46.579258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b8acd-2ef2-4c0a-802f-6e5bbe77c843 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:46.588890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 727/1455] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:07:48.832456 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b59cd-c273-4c80-8cfa-4e049ab56e55 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:48.833281 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b59cd-c273-4c80-8cfa-4e049ab56e55 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:48.833454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b59cd-c273-4c80-8cfa-4e049ab56e55 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:48.835787 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:07:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:48.841366 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8ada-0d7e-4e0c-bc96-0b19762266c9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:48.841815 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8ada-0d7e-4e0c-bc96-0b19762266c9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:48.841920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8ada-0d7e-4e0c-bc96-0b19762266c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:48.860170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-708d8ada-0d7e-4e0c-bc96-0b19762266c9 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:48.861377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-708d8ada-0d7e-4e0c-bc96-0b19762266c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:48.869796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:48.907769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b59cd-c273-4c80-8cfa-4e049ab56e55 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:48.926170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b59cd-c273-4c80-8cfa-4e049ab56e55 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:48.933442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc7779-99eb-4c0e-b31d-1476c369d825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:48.934389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc7779-99eb-4c0e-b31d-1476c369d825 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:48.934791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc7779-99eb-4c0e-b31d-1476c369d825 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:48.935119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc7779-99eb-4c0e-b31d-1476c369d825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:48.945701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc7779-99eb-4c0e-b31d-1476c369d825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:48.947139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc7779-99eb-4c0e-b31d-1476c369d825 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:48.956715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 730/1458] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:51.214235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f02eb-8463-42c8-beaa-d0d5b6127c90 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:51.215148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f02eb-8463-42c8-beaa-d0d5b6127c90 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:51.215148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f02eb-8463-42c8-beaa-d0d5b6127c90 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:51.217506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:07:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:51.223871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458e8c9-5271-4792-b67e-77116ff96ba1 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:51.224296 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458e8c9-5271-4792-b67e-77116ff96ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:51.224411 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458e8c9-5271-4792-b67e-77116ff96ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:51.234209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=70 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:51.251755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-0458e8c9-5271-4792-b67e-77116ff96ba1 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:51.253055 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-0458e8c9-5271-4792-b67e-77116ff96ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:51.262482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:51.300701 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f02eb-8463-42c8-beaa-d0d5b6127c90 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:51.307941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=73 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:51.315660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f02eb-8463-42c8-beaa-d0d5b6127c90 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:51.319291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed85ba4-dbf2-4d3d-8cf3-b308e28c68cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:51.319980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed85ba4-dbf2-4d3d-8cf3-b308e28c68cd service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:51.320272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed85ba4-dbf2-4d3d-8cf3-b308e28c68cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:51.320554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed85ba4-dbf2-4d3d-8cf3-b308e28c68cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:51.329595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed85ba4-dbf2-4d3d-8cf3-b308e28c68cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:51.331024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed85ba4-dbf2-4d3d-8cf3-b308e28c68cd service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:51.340405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 730/1461] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:53.592403 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313473f-b2f8-4125-83f8-1b291e15f13a None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:53.593146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313473f-b2f8-4125-83f8-1b291e15f13a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:53.593146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313473f-b2f8-4125-83f8-1b291e15f13a None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:53.595255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:53.604626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f7273-ac63-47c5-930c-17863b50a935 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:53.605455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f7273-ac63-47c5-930c-17863b50a935 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:53.605650 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f7273-ac63-47c5-930c-17863b50a935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:53.631708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-0e8f7273-ac63-47c5-930c-17863b50a935 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:53.632921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0e8f7273-ac63-47c5-930c-17863b50a935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:53.642304 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:53.678837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313473f-b2f8-4125-83f8-1b291e15f13a None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:53.691486 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313473f-b2f8-4125-83f8-1b291e15f13a None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:53.697389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a8008-a1eb-4797-beeb-1264bb9a98bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:53.698239 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a8008-a1eb-4797-beeb-1264bb9a98bc service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:53.698641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a8008-a1eb-4797-beeb-1264bb9a98bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:53.698982 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a8008-a1eb-4797-beeb-1264bb9a98bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:53.714547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a8008-a1eb-4797-beeb-1264bb9a98bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:53.716756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a8008-a1eb-4797-beeb-1264bb9a98bc service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:53.726905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 733/1464] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:56.045598 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f16c5-1e08-4d37-8496-f5cda60b0620 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:56.046463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f16c5-1e08-4d37-8496-f5cda60b0620 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:56.046463 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f16c5-1e08-4d37-8496-f5cda60b0620 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:56.047921 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:56.053591 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd71f2-9f21-4fa5-aa53-61fa86707294 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:56.054053 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd71f2-9f21-4fa5-aa53-61fa86707294 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:56.054159 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd71f2-9f21-4fa5-aa53-61fa86707294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:56.074943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-36dd71f2-9f21-4fa5-aa53-61fa86707294 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:56.076834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-36dd71f2-9f21-4fa5-aa53-61fa86707294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:56.087042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:56.125433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f16c5-1e08-4d37-8496-f5cda60b0620 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:56.138565 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f16c5-1e08-4d37-8496-f5cda60b0620 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:56.142630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fc021-1f31-49a0-915c-ae33d6b06936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:56.143268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fc021-1f31-49a0-915c-ae33d6b06936 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:56.143551 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fc021-1f31-49a0-915c-ae33d6b06936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:56.143859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fc021-1f31-49a0-915c-ae33d6b06936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:56.154306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fc021-1f31-49a0-915c-ae33d6b06936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:56.155776 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fc021-1f31-49a0-915c-ae33d6b06936 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:56.165354 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 733/1467] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:58.382163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764be11-f2c5-4c10-b87c-a58687af75a3 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:58.382782 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764be11-f2c5-4c10-b87c-a58687af75a3 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:58.382782 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764be11-f2c5-4c10-b87c-a58687af75a3 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:58.384209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:58.390470 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2b45a-bbac-4bd7-b1bc-7390f51fbd1e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:58.390911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2b45a-bbac-4bd7-b1bc-7390f51fbd1e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:58.391072 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2b45a-bbac-4bd7-b1bc-7390f51fbd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:58.409425 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-fee2b45a-bbac-4bd7-b1bc-7390f51fbd1e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:58.410633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-fee2b45a-bbac-4bd7-b1bc-7390f51fbd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:58.418969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:58.456188 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764be11-f2c5-4c10-b87c-a58687af75a3 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:58.468246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764be11-f2c5-4c10-b87c-a58687af75a3 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:58.472244 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd5a1f-c71a-4865-afe1-f487eae7554c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:58.472861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd5a1f-c71a-4865-afe1-f487eae7554c service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:58.473180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd5a1f-c71a-4865-afe1-f487eae7554c service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:58.473459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd5a1f-c71a-4865-afe1-f487eae7554c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:58.482896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd5a1f-c71a-4865-afe1-f487eae7554c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:58.484453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd5a1f-c71a-4865-afe1-f487eae7554c service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:58.493849 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 736/1470] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:08.403933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=17 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:08.489546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=17 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:31.230761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e8dbb-d5c2-4d85-aefd-c37dd7adbe96 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:31.231758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e8dbb-d5c2-4d85-aefd-c37dd7adbe96 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:31.231758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e8dbb-d5c2-4d85-aefd-c37dd7adbe96 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:31.234109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 735/1471] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:08:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:31.241450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa0fba-a397-4627-81c1-df42cc8589e2 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:31.241966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa0fba-a397-4627-81c1-df42cc8589e2 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:31.241966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa0fba-a397-4627-81c1-df42cc8589e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:31.260474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-eeaa0fba-a397-4627-81c1-df42cc8589e2 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:31.261684 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-eeaa0fba-a397-4627-81c1-df42cc8589e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:31.271140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 737/1472] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:31.325932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d92351-0259-4d07-88a7-2f4a6b93eb85 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:31.326251 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d92351-0259-4d07-88a7-2f4a6b93eb85 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:31.326535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d92351-0259-4d07-88a7-2f4a6b93eb85 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:31.328079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 736/1473] 10.222.0.24 () {54 vars in 962 bytes} [Wed May 25 15:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:31.333140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d0b1e-10a7-4baa-886a-8fc5462b8de4 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:31.333443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d0b1e-10a7-4baa-886a-8fc5462b8de4 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:31.333716 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d0b1e-10a7-4baa-886a-8fc5462b8de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:31.353485 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-ca1d0b1e-10a7-4baa-886a-8fc5462b8de4 None None] MFA Rules not processed for user `79f0aa2ddbcb494f8a5a53399793aa2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:31.354693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-ca1d0b1e-10a7-4baa-886a-8fc5462b8de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:31.362499 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 738/1474] 10.222.0.24 () {58 vars in 1059 bytes} [Wed May 25 15:08:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:31.370646 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d92351-0259-4d07-88a7-2f4a6b93eb85 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:31.387903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d92351-0259-4d07-88a7-2f4a6b93eb85 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:31.392545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815053-9794-429a-b565-30fe889c080b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f0aa2ddbcb494f8a5a53399793aa2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:31.393260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815053-9794-429a-b565-30fe889c080b service glance] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:31.393545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815053-9794-429a-b565-30fe889c080b service glance] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:31.393849 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815053-9794-429a-b565-30fe889c080b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:31.404266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd815053-9794-429a-b565-30fe889c080b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:31.405688 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd815053-9794-429a-b565-30fe889c080b service glance] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:31.415974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 737/1475] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:33.710796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0a65-0ec3-43d9-b2f7-9cc644f6f870 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:33.711642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0a65-0ec3-43d9-b2f7-9cc644f6f870 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:33.711642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0a65-0ec3-43d9-b2f7-9cc644f6f870 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:33.713769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 739/1476] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:08:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:33.721865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb374f6-5d27-4d8f-af3b-48c55d4811d7 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:33.722289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb374f6-5d27-4d8f-af3b-48c55d4811d7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:33.722556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb374f6-5d27-4d8f-af3b-48c55d4811d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:33.741579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-dbb374f6-5d27-4d8f-af3b-48c55d4811d7 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:33.742764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dbb374f6-5d27-4d8f-af3b-48c55d4811d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:33.751069 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 738/1477] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:08:33.774895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b0a65-0ec3-43d9-b2f7-9cc644f6f870 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:33.795283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b0a65-0ec3-43d9-b2f7-9cc644f6f870 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:33.803770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea9c84-159e-4171-b270-70395c306e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:33.804724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea9c84-159e-4171-b270-70395c306e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:33.805113 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea9c84-159e-4171-b270-70395c306e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:33.805530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea9c84-159e-4171-b270-70395c306e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:33.806770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea9c84-159e-4171-b270-70395c306e12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:33.809594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: WARNING py.warnings [None req-62ea9c84-159e-4171-b270-70395c306e12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:08:33.809594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: warnings.warn(msg) May 25 15:08:33.809594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: May 25 15:08:33.811240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea9c84-159e-4171-b270-70395c306e12 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:33.837388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 740/1478] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 15:08:33 2022] GET /identity/v3/projects => generated 2553 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:08:36.081466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962b64-e3a7-42b8-91b7-44ae677ddea2 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:36.082358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962b64-e3a7-42b8-91b7-44ae677ddea2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:36.082358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962b64-e3a7-42b8-91b7-44ae677ddea2 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:36.084629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 739/1479] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:08:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:36.091009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4171ee8-3e8a-4364-a7f4-2a0042d8f16c None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:36.091817 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4171ee8-3e8a-4364-a7f4-2a0042d8f16c None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:36.091994 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4171ee8-3e8a-4364-a7f4-2a0042d8f16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:36.112838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-a4171ee8-3e8a-4364-a7f4-2a0042d8f16c None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:36.114070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-a4171ee8-3e8a-4364-a7f4-2a0042d8f16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:36.124442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 741/1480] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:36.172037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962b64-e3a7-42b8-91b7-44ae677ddea2 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:36.188025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962b64-e3a7-42b8-91b7-44ae677ddea2 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:36.193496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3d7a6-ea2c-41c6-bb84-e2d96dfdcc12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:36.194634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3d7a6-ea2c-41c6-bb84-e2d96dfdcc12 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:36.194923 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3d7a6-ea2c-41c6-bb84-e2d96dfdcc12 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:36.195204 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3d7a6-ea2c-41c6-bb84-e2d96dfdcc12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:36.203525 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3d7a6-ea2c-41c6-bb84-e2d96dfdcc12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:36.207529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3d7a6-ea2c-41c6-bb84-e2d96dfdcc12 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:36.218609 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 740/1481] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:38.601964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d433fc-f09e-447b-b64f-927a9dc3b28e None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:38.602902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d433fc-f09e-447b-b64f-927a9dc3b28e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:38.602902 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d433fc-f09e-447b-b64f-927a9dc3b28e None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:38.605256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 742/1482] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:08:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:38.611476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642ee84-233d-4eb5-9f6f-89e253f0b2f8 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:38.612254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642ee84-233d-4eb5-9f6f-89e253f0b2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:38.612489 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642ee84-233d-4eb5-9f6f-89e253f0b2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:38.632405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-a642ee84-233d-4eb5-9f6f-89e253f0b2f8 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:38.633587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-a642ee84-233d-4eb5-9f6f-89e253f0b2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:38.641858 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 741/1483] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:38.677479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d433fc-f09e-447b-b64f-927a9dc3b28e None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:38.693443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d433fc-f09e-447b-b64f-927a9dc3b28e None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:38.697781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef42995-f76c-47ca-9dbd-76720a0d43da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:38.698424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef42995-f76c-47ca-9dbd-76720a0d43da service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:38.698710 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef42995-f76c-47ca-9dbd-76720a0d43da service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:38.698985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef42995-f76c-47ca-9dbd-76720a0d43da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:38.708302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef42995-f76c-47ca-9dbd-76720a0d43da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:38.709667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef42995-f76c-47ca-9dbd-76720a0d43da service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:38.719100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 743/1484] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:40.980494 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389e7bb-69e4-46cb-b5d8-b2c8ceb1e40f None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:40.981103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389e7bb-69e4-46cb-b5d8-b2c8ceb1e40f None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:40.981103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389e7bb-69e4-46cb-b5d8-b2c8ceb1e40f None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:40.982458 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 742/1485] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:40.987932 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785b314-c789-422c-a202-8413846bf85f None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:40.988377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785b314-c789-422c-a202-8413846bf85f None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:40.988491 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785b314-c789-422c-a202-8413846bf85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:41.007886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-3785b314-c789-422c-a202-8413846bf85f None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:41.009140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-3785b314-c789-422c-a202-8413846bf85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:41.017739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 744/1486] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:41.055859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389e7bb-69e4-46cb-b5d8-b2c8ceb1e40f None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:41.074325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389e7bb-69e4-46cb-b5d8-b2c8ceb1e40f None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:41.079927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25414b1-e7aa-47d3-9cea-8804262411ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:41.080576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25414b1-e7aa-47d3-9cea-8804262411ab service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:41.080865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25414b1-e7aa-47d3-9cea-8804262411ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:41.081141 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25414b1-e7aa-47d3-9cea-8804262411ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:41.094388 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25414b1-e7aa-47d3-9cea-8804262411ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:41.096552 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25414b1-e7aa-47d3-9cea-8804262411ab service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:41.110535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 743/1487] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:43.457679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784360f-8022-4369-a33f-5dfe85cc8a9c None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:43.458206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784360f-8022-4369-a33f-5dfe85cc8a9c None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:43.458206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784360f-8022-4369-a33f-5dfe85cc8a9c None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:43.459674 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 745/1488] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:43.465719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33888221-50ff-41d7-a2bc-0555a0b45e39 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:43.466182 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33888221-50ff-41d7-a2bc-0555a0b45e39 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:43.466291 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33888221-50ff-41d7-a2bc-0555a0b45e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:43.492326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-33888221-50ff-41d7-a2bc-0555a0b45e39 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:43.493546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-33888221-50ff-41d7-a2bc-0555a0b45e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:43.501567 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 744/1489] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:43.544448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784360f-8022-4369-a33f-5dfe85cc8a9c None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:43.557490 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784360f-8022-4369-a33f-5dfe85cc8a9c None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:43.561888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b2a33-148a-4886-b08e-d16f34d130c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:43.562843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b2a33-148a-4886-b08e-d16f34d130c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:43.563124 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b2a33-148a-4886-b08e-d16f34d130c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:43.563395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b2a33-148a-4886-b08e-d16f34d130c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:43.573347 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b2a33-148a-4886-b08e-d16f34d130c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:43.574810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b2a33-148a-4886-b08e-d16f34d130c1 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:43.584299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 746/1490] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:46.050754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ac50d-79f9-4ac2-97ba-0fd6229e7469 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:46.051751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ac50d-79f9-4ac2-97ba-0fd6229e7469 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:46.051751 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ac50d-79f9-4ac2-97ba-0fd6229e7469 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:46.053920 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 745/1491] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 15:08:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:46.059392 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93586c6b-6caf-40d4-b028-bfe7cb4eb81d None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:46.059907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93586c6b-6caf-40d4-b028-bfe7cb4eb81d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:46.060010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93586c6b-6caf-40d4-b028-bfe7cb4eb81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:46.079136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-93586c6b-6caf-40d4-b028-bfe7cb4eb81d None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:46.080398 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-93586c6b-6caf-40d4-b028-bfe7cb4eb81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:46.089624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 747/1492] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 15:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:46.129380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ac50d-79f9-4ac2-97ba-0fd6229e7469 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:46.141386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ac50d-79f9-4ac2-97ba-0fd6229e7469 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:46.145709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c8f3d-ebee-4ca4-b752-618dfe82a0fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:46.146332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c8f3d-ebee-4ca4-b752-618dfe82a0fa service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:46.146615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c8f3d-ebee-4ca4-b752-618dfe82a0fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:46.146890 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c8f3d-ebee-4ca4-b752-618dfe82a0fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:46.156297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c8f3d-ebee-4ca4-b752-618dfe82a0fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:46.157847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c8f3d-ebee-4ca4-b752-618dfe82a0fa service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:46.167545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 746/1493] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:56.073626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=33 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:56.163270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=33 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:26.467816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c783f-c8c5-44ed-8382-9be523d638ea None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:26.468377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c783f-c8c5-44ed-8382-9be523d638ea None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:26.468377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c783f-c8c5-44ed-8382-9be523d638ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:26.487221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-636c783f-c8c5-44ed-8382-9be523d638ea None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:26.488421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-636c783f-c8c5-44ed-8382-9be523d638ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:26.498882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 748/1494] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:26.508394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d463f-5e87-402c-9604-0609d43a3317 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:26.508911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d463f-5e87-402c-9604-0609d43a3317 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:26.508911 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d463f-5e87-402c-9604-0609d43a3317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:26.527832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-d69d463f-5e87-402c-9604-0609d43a3317 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:26.529001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-d69d463f-5e87-402c-9604-0609d43a3317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:26.537703 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 747/1495] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:26.542772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c783f-c8c5-44ed-8382-9be523d638ea None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:26.555068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c783f-c8c5-44ed-8382-9be523d638ea None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:26.561139 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c5ea3-1272-4c96-bda8-3ab35e323205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:26.561805 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c5ea3-1272-4c96-bda8-3ab35e323205 admin admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:26.562092 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c5ea3-1272-4c96-bda8-3ab35e323205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:26.562340 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c5ea3-1272-4c96-bda8-3ab35e323205 admin admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:26.563077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c5ea3-1272-4c96-bda8-3ab35e323205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:10:26.563386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c5ea3-1272-4c96-bda8-3ab35e323205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:26.564467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: WARNING py.warnings [None req-2a0c5ea3-1272-4c96-bda8-3ab35e323205 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:10:26.564467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: warnings.warn(msg) May 25 15:10:26.564467 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: May 25 15:10:26.565344 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c5ea3-1272-4c96-bda8-3ab35e323205 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:26.577733 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 749/1496] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 15:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:10:26.587059 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d463f-5e87-402c-9604-0609d43a3317 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:26.602413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d463f-5e87-402c-9604-0609d43a3317 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:26.611105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c655649-d44c-4986-96e5-7f921605ca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:26.611803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c655649-d44c-4986-96e5-7f921605ca73 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:26.612110 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c655649-d44c-4986-96e5-7f921605ca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:26.612389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c655649-d44c-4986-96e5-7f921605ca73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:26.613096 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c655649-d44c-4986-96e5-7f921605ca73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:26.614903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-9c655649-d44c-4986-96e5-7f921605ca73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:10:26.614903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: warnings.warn(msg) May 25 15:10:26.614903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: May 25 15:10:26.616173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c655649-d44c-4986-96e5-7f921605ca73 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:26.657509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 748/1497] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 15:10:26 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:10:26.661894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c5ea3-1272-4c96-bda8-3ab35e323205 admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:26.672283 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c5ea3-1272-4c96-bda8-3ab35e323205 admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:26.727400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9497b15-bb56-4e82-b52c-488b630fba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:26.728033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9497b15-bb56-4e82-b52c-488b630fba94 admin admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:26.728317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9497b15-bb56-4e82-b52c-488b630fba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:26.728584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9497b15-bb56-4e82-b52c-488b630fba94 admin admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:26.729325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9497b15-bb56-4e82-b52c-488b630fba94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:26.730353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: WARNING py.warnings [None req-f9497b15-bb56-4e82-b52c-488b630fba94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:10:26.730353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: warnings.warn(msg) May 25 15:10:26.730353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: May 25 15:10:26.731531 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9497b15-bb56-4e82-b52c-488b630fba94 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:26.755150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 750/1498] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 15:10:26 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:10:26.763473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c655649-d44c-4986-96e5-7f921605ca73 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:26.774496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c655649-d44c-4986-96e5-7f921605ca73 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:26.779851 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616402e-563a-44ad-8266-ee6388e84e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:26.780521 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616402e-563a-44ad-8266-ee6388e84e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:26.780824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616402e-563a-44ad-8266-ee6388e84e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:26.781100 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616402e-563a-44ad-8266-ee6388e84e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:26.781838 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616402e-563a-44ad-8266-ee6388e84e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:26.782906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-e616402e-563a-44ad-8266-ee6388e84e84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:10:26.782906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: warnings.warn(msg) May 25 15:10:26.782906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: May 25 15:10:26.783816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616402e-563a-44ad-8266-ee6388e84e84 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:26.797262 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 749/1499] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 15:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:10:26.801893 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9497b15-bb56-4e82-b52c-488b630fba94 admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:26.811889 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9497b15-bb56-4e82-b52c-488b630fba94 admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:26.818572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465fed3-3e9b-4d19-bf8a-cb21b1f4b361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:26.819225 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465fed3-3e9b-4d19-bf8a-cb21b1f4b361 admin admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:26.819509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465fed3-3e9b-4d19-bf8a-cb21b1f4b361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:26.819822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465fed3-3e9b-4d19-bf8a-cb21b1f4b361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:26.820557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465fed3-3e9b-4d19-bf8a-cb21b1f4b361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:26.821584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: WARNING py.warnings [None req-7465fed3-3e9b-4d19-bf8a-cb21b1f4b361 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:10:26.821584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: warnings.warn(msg) May 25 15:10:26.821584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: May 25 15:10:26.822451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465fed3-3e9b-4d19-bf8a-cb21b1f4b361 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:26.835917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 751/1500] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 15:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:10:26.840181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616402e-563a-44ad-8266-ee6388e84e84 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:26.850568 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616402e-563a-44ad-8266-ee6388e84e84 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:26.856376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063ed15-a484-483c-9640-8fcb55637e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:26.857263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063ed15-a484-483c-9640-8fcb55637e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:26.857548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063ed15-a484-483c-9640-8fcb55637e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:26.857822 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063ed15-a484-483c-9640-8fcb55637e31 admin admin] PATH_INFO: `/v3/projects/ecc1ba711116428c9d2c167590a9e811/users/f82963044f87453db218f9a66b829e98/roles/88c41930377947b7a1dc0134ba0f787b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:26.874293 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063ed15-a484-483c-9640-8fcb55637e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc1ba711116428c9d2c167590a9e811, user_id=f82963044f87453db218f9a66b829e98, role_id=88c41930377947b7a1dc0134ba0f787b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:26.875327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-b063ed15-a484-483c-9640-8fcb55637e31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:10:26.875327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: warnings.warn(msg) May 25 15:10:26.875327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: May 25 15:10:26.877382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063ed15-a484-483c-9640-8fcb55637e31 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:26.892376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 750/1501] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 15:10:26 2022] PUT /identity/v3/projects/ecc1ba711116428c9d2c167590a9e811/users/f82963044f87453db218f9a66b829e98/roles/88c41930377947b7a1dc0134ba0f787b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:26.903896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8598fd-2430-46f3-9ecd-93825e88865e None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:26.904189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8598fd-2430-46f3-9ecd-93825e88865e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:26.904474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8598fd-2430-46f3-9ecd-93825e88865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:26.933643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-3d8598fd-2430-46f3-9ecd-93825e88865e None None] MFA Rules not processed for user `f82963044f87453db218f9a66b829e98`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:26.935178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-3d8598fd-2430-46f3-9ecd-93825e88865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:27.003871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 752/1502] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:10:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:27.022460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e0de4-154d-43a1-9510-b5ed5b45bd1a None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:27.022757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e0de4-154d-43a1-9510-b5ed5b45bd1a None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:27.023134 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e0de4-154d-43a1-9510-b5ed5b45bd1a None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:27.025172 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 751/1503] 10.222.0.24 () {54 vars in 963 bytes} [Wed May 25 15:10:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:10:27.032152 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ccb11-fb34-4826-9178-c8ad253d2364 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:27.032530 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ccb11-fb34-4826-9178-c8ad253d2364 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:27.032803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ccb11-fb34-4826-9178-c8ad253d2364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:27.051821 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-0b1ccb11-fb34-4826-9178-c8ad253d2364 None None] MFA Rules not processed for user `49e5814865044696a7d0021d44629604`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:27.053008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-0b1ccb11-fb34-4826-9178-c8ad253d2364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:27.099407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:27.108898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 753/1504] 10.222.0.24 () {58 vars in 1060 bytes} [Wed May 25 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:27.116796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e0de4-154d-43a1-9510-b5ed5b45bd1a None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:27.131541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e0de4-154d-43a1-9510-b5ed5b45bd1a None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:27.135633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb57636-83f6-4aa5-bb59-43f1a7b1dd47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49e5814865044696a7d0021d44629604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:27.136302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb57636-83f6-4aa5-bb59-43f1a7b1dd47 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:27.136611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb57636-83f6-4aa5-bb59-43f1a7b1dd47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:27.136867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb57636-83f6-4aa5-bb59-43f1a7b1dd47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:27.145769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb57636-83f6-4aa5-bb59-43f1a7b1dd47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:27.147200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb57636-83f6-4aa5-bb59-43f1a7b1dd47 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:27.156246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 752/1505] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:10:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:27.204107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14b855-25f9-4444-a8f1-8febd40c1cfb None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:27.204443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14b855-25f9-4444-a8f1-8febd40c1cfb None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:27.204720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14b855-25f9-4444-a8f1-8febd40c1cfb None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:27.206020 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 754/1506] 10.222.0.24 () {52 vars in 829 bytes} [Wed May 25 15:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:10:27.209836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb57636-83f6-4aa5-bb59-43f1a7b1dd47 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:27.287044 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb57636-83f6-4aa5-bb59-43f1a7b1dd47 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:27.293205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:27.294227 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:27.294642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:27.295001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] PATH_INFO: `/v3/users/f82963044f87453db218f9a66b829e98` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:27.296695 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82963044f87453db218f9a66b829e98)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:27.297880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:10:27.297880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: warnings.warn(msg) May 25 15:10:27.297880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: May 25 15:10:27.299694 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:27.387030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82963044f87453db218f9a66b829e98'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:27.406628 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82963044f87453db218f9a66b829e98'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:27.407341 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82963044f87453db218f9a66b829e98'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:27.417374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82963044f87453db218f9a66b829e98'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:27.418157 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82963044f87453db218f9a66b829e98'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:27.426985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:27.438237 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 753/1507] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 15:10:27 2022] DELETE /identity/v3/users/f82963044f87453db218f9a66b829e98 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:27.442884 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f7fab-d54f-4bfa-9f1d-15dd9333446e None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:27.443175 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f7fab-d54f-4bfa-9f1d-15dd9333446e None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:27.443460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f7fab-d54f-4bfa-9f1d-15dd9333446e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:27.461458 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-767f7fab-d54f-4bfa-9f1d-15dd9333446e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:27.462662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-767f7fab-d54f-4bfa-9f1d-15dd9333446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:27.523758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 755/1508] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:27.535118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:27.536603 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:27.597973 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32a8ba-2a97-4195-819f-01aeb176859c admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:27.604608 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1922943-e414-4947-bd76-d6602128f686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:27.605275 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1922943-e414-4947-bd76-d6602128f686 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:27.606288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1922943-e414-4947-bd76-d6602128f686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:27.606288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1922943-e414-4947-bd76-d6602128f686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:27.617843 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1922943-e414-4947-bd76-d6602128f686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:27.620064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1922943-e414-4947-bd76-d6602128f686 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:27.632842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 754/1509] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:28.028172 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f7fab-d54f-4bfa-9f1d-15dd9333446e None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:28.029707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-767f7fab-d54f-4bfa-9f1d-15dd9333446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:28.041771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f7fab-d54f-4bfa-9f1d-15dd9333446e None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:28.046651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:28.047522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:28.047865 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:28.048245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] PATH_INFO: `/v3/projects/ecc1ba711116428c9d2c167590a9e811` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:28.049478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc1ba711116428c9d2c167590a9e811)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:28.050529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: WARNING py.warnings [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:10:28.050529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: warnings.warn(msg) May 25 15:10:28.050529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: May 25 15:10:28.051774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:28.114849 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc1ba711116428c9d2c167590a9e811', 'request_id': 'req-f234ce2d-36d3-442a-8260-205f68678f9b'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:28.120918 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc1ba711116428c9d2c167590a9e811', 'request_id': 'req-f234ce2d-36d3-442a-8260-205f68678f9b'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:28.134892 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc1ba711116428c9d2c167590a9e811', 'request_id': 'req-f234ce2d-36d3-442a-8260-205f68678f9b'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:28.150287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] The token cache is being invalidate because project ecc1ba711116428c9d2c167590a9e811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80325) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:10:28.150572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:28.151214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-f234ce2d-36d3-442a-8260-205f68678f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:10:28.152904 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 756/1510] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 15:10:28 2022] DELETE /identity/v3/projects/ecc1ba711116428c9d2c167590a9e811 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:10:37.628235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=29 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:38.147545 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:11:47.244385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772a74e-7cfa-4d2e-8653-3ce55792bd8d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:47.244993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772a74e-7cfa-4d2e-8653-3ce55792bd8d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:47.244993 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772a74e-7cfa-4d2e-8653-3ce55792bd8d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:47.247109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:11:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:11:47.254488 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec0fb1-e81d-483c-983d-f149642925c8 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:47.254901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec0fb1-e81d-483c-983d-f149642925c8 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:47.255057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec0fb1-e81d-483c-983d-f149642925c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:47.276384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-92ec0fb1-e81d-483c-983d-f149642925c8 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:47.277608 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-92ec0fb1-e81d-483c-983d-f149642925c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:47.347428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:47.515892 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772a74e-7cfa-4d2e-8653-3ce55792bd8d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:47.518847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4772a74e-7cfa-4d2e-8653-3ce55792bd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:47.607996 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772a74e-7cfa-4d2e-8653-3ce55792bd8d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:47.616382 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b70be1-dc7f-4002-8e42-bd4650cdf753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:47.617027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b70be1-dc7f-4002-8e42-bd4650cdf753 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:47.617308 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b70be1-dc7f-4002-8e42-bd4650cdf753 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:47.617747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b70be1-dc7f-4002-8e42-bd4650cdf753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:47.626550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b70be1-dc7f-4002-8e42-bd4650cdf753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:47.628185 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b70be1-dc7f-4002-8e42-bd4650cdf753 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:47.637816 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 756/1513] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:11:48.529792 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5e72a-5482-4bee-9ec3-dc304f1b589d None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:48.530686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5e72a-5482-4bee-9ec3-dc304f1b589d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:48.530686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5e72a-5482-4bee-9ec3-dc304f1b589d None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:48.533000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:11:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:11:48.538827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e805d57-65d3-4724-88bf-15592b5db89e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:48.539305 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e805d57-65d3-4724-88bf-15592b5db89e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:48.539408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e805d57-65d3-4724-88bf-15592b5db89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:48.564151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1e805d57-65d3-4724-88bf-15592b5db89e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:48.565469 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1e805d57-65d3-4724-88bf-15592b5db89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:48.574429 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:48.733654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5e72a-5482-4bee-9ec3-dc304f1b589d None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:48.750566 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5e72a-5482-4bee-9ec3-dc304f1b589d None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:48.756563 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af990665-ac54-4455-8cf4-718811d52167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:48.757196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af990665-ac54-4455-8cf4-718811d52167 service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:48.757480 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af990665-ac54-4455-8cf4-718811d52167 service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:48.757755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af990665-ac54-4455-8cf4-718811d52167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:48.766022 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af990665-ac54-4455-8cf4-718811d52167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:48.767666 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af990665-ac54-4455-8cf4-718811d52167 service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:48.777937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 759/1516] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:11:52.219117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8be2c-944d-4481-9926-002eb11e8cc5 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:52.219848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8be2c-944d-4481-9926-002eb11e8cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:52.219975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8be2c-944d-4481-9926-002eb11e8cc5 None None] PATH_INFO: `/v3` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:52.221306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 758/1517] 10.222.0.45 () {54 vars in 925 bytes} [Wed May 25 15:11:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:11:52.229657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5165eba-4b67-4b2f-a854-e22bbd53f7e4 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:52.230089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5165eba-4b67-4b2f-a854-e22bbd53f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:52.230202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5165eba-4b67-4b2f-a854-e22bbd53f7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:52.249561 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-d5165eba-4b67-4b2f-a854-e22bbd53f7e4 None None] MFA Rules not processed for user `3b717fe1f83743eabe4be630ddbe508c`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:52.250780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-d5165eba-4b67-4b2f-a854-e22bbd53f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:52.322873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 760/1518] 10.222.0.45 () {58 vars in 1015 bytes} [Wed May 25 15:11:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:11:56.420897 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8c954-41cf-46fb-8d3b-25d17c1f169d None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:56.421785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8c954-41cf-46fb-8d3b-25d17c1f169d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:56.422002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8c954-41cf-46fb-8d3b-25d17c1f169d None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:56.424191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 759/1519] 10.222.0.24 () {54 vars in 960 bytes} [Wed May 25 15:11:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:11:56.431974 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a67a-63a2-4870-8fc4-8c1793fc722d None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:56.432443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a67a-63a2-4870-8fc4-8c1793fc722d None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:56.432546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a67a-63a2-4870-8fc4-8c1793fc722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:56.452222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-5db0a67a-63a2-4870-8fc4-8c1793fc722d None None] MFA Rules not processed for user `3b717fe1f83743eabe4be630ddbe508c`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:11:56.453432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-5db0a67a-63a2-4870-8fc4-8c1793fc722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:11:56.463735 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 761/1520] 10.222.0.24 () {58 vars in 1057 bytes} [Wed May 25 15:11:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:11:56.471306 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8c954-41cf-46fb-8d3b-25d17c1f169d None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:11:56.485605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8c954-41cf-46fb-8d3b-25d17c1f169d None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:11:56.491037 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bff67-8842-4374-ba8b-5d3324a31d0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b717fe1f83743eabe4be630ddbe508c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:11:56.491713 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bff67-8842-4374-ba8b-5d3324a31d0d service placement] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:11:56.491997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bff67-8842-4374-ba8b-5d3324a31d0d service placement] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:11:56.492272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bff67-8842-4374-ba8b-5d3324a31d0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:11:56.500759 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bff67-8842-4374-ba8b-5d3324a31d0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:11:56.502346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bff67-8842-4374-ba8b-5d3324a31d0d service placement] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:11:56.512131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 760/1521] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:11:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:00.076474 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa89a12-7745-449b-b586-4588d5e9a4c2 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:00.077103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa89a12-7745-449b-b586-4588d5e9a4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:00.077103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa89a12-7745-449b-b586-4588d5e9a4c2 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:00.078408 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:12:00.084616 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa747af-749d-4a3e-b7bb-c6f0678a0f65 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:00.085318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa747af-749d-4a3e-b7bb-c6f0678a0f65 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:00.085498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa747af-749d-4a3e-b7bb-c6f0678a0f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:00.110206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-1fa747af-749d-4a3e-b7bb-c6f0678a0f65 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:00.111401 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-1fa747af-749d-4a3e-b7bb-c6f0678a0f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:00.122047 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:00.283041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa89a12-7745-449b-b586-4588d5e9a4c2 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:00.305961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa89a12-7745-449b-b586-4588d5e9a4c2 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:00.312466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46c054-ed5e-4ed6-9895-b6ed947db374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:00.313112 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46c054-ed5e-4ed6-9895-b6ed947db374 service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:00.313400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46c054-ed5e-4ed6-9895-b6ed947db374 service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:00.313680 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46c054-ed5e-4ed6-9895-b6ed947db374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:00.322642 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46c054-ed5e-4ed6-9895-b6ed947db374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:00.324292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46c054-ed5e-4ed6-9895-b6ed947db374 service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:00.334136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 763/1524] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:01.206365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c7d01-a581-45bb-b0f7-689d403b0a3e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:01.206891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c7d01-a581-45bb-b0f7-689d403b0a3e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:01.206891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c7d01-a581-45bb-b0f7-689d403b0a3e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.208369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:12:01.214316 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ee78-4af8-4631-927c-b8500814c7c3 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:01.214756 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ee78-4af8-4631-927c-b8500814c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:01.214895 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ee78-4af8-4631-927c-b8500814c7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.241636 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-4456ee78-4af8-4631-927c-b8500814c7c3 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:01.242840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-4456ee78-4af8-4631-927c-b8500814c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:01.251892 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:01.403821 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c7d01-a581-45bb-b0f7-689d403b0a3e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:01.422628 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c7d01-a581-45bb-b0f7-689d403b0a3e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:01.428909 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205176e9-c0de-4f7e-bee6-13ca4f71f9fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:01.429557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205176e9-c0de-4f7e-bee6-13ca4f71f9fa service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:01.429844 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205176e9-c0de-4f7e-bee6-13ca4f71f9fa service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:01.430123 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205176e9-c0de-4f7e-bee6-13ca4f71f9fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:01.438657 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205176e9-c0de-4f7e-bee6-13ca4f71f9fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:01.440370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205176e9-c0de-4f7e-bee6-13ca4f71f9fa service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:01.450328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 763/1527] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:05.427857 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7654-6741-42ad-93c0-04d414459554 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:05.428412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7654-6741-42ad-93c0-04d414459554 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:05.428412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7654-6741-42ad-93c0-04d414459554 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:05.429700 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:12:05.435103 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4d2d3-f600-42bb-aa85-fc81963fe0b3 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:05.435607 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4d2d3-f600-42bb-aa85-fc81963fe0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:05.435708 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4d2d3-f600-42bb-aa85-fc81963fe0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:05.456393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-f3c4d2d3-f600-42bb-aa85-fc81963fe0b3 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:05.457601 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-f3c4d2d3-f600-42bb-aa85-fc81963fe0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:05.465837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:05.505634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7654-6741-42ad-93c0-04d414459554 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:05.508761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-522f7654-6741-42ad-93c0-04d414459554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:05.577744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7654-6741-42ad-93c0-04d414459554 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:05.582292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1240fb-1c46-45af-b7e0-02df309cb13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:05.582941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1240fb-1c46-45af-b7e0-02df309cb13d service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:05.583226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1240fb-1c46-45af-b7e0-02df309cb13d service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:05.583510 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1240fb-1c46-45af-b7e0-02df309cb13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:05.593355 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1240fb-1c46-45af-b7e0-02df309cb13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:05.594794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1240fb-1c46-45af-b7e0-02df309cb13d service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:05.599807 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:05.604785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 766/1530] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:07.804287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bce36-20c6-4751-a589-0c14adbd5af7 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:07.804908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bce36-20c6-4751-a589-0c14adbd5af7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:07.804908 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bce36-20c6-4751-a589-0c14adbd5af7 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:07.806267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:12:07.812724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6640c-f547-4a08-9b79-7a48452b39da None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:07.813500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6640c-f547-4a08-9b79-7a48452b39da None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:07.813644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6640c-f547-4a08-9b79-7a48452b39da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:07.840771 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-20f6640c-f547-4a08-9b79-7a48452b39da None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:07.842015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-20f6640c-f547-4a08-9b79-7a48452b39da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:07.852213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:07.895070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bce36-20c6-4751-a589-0c14adbd5af7 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:07.897400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-738bce36-20c6-4751-a589-0c14adbd5af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:07.910358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=56 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:07.919971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bce36-20c6-4751-a589-0c14adbd5af7 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:07.925696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124b56d-d8eb-4817-8c3f-f7097e1c67d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:07.926421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124b56d-d8eb-4817-8c3f-f7097e1c67d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:07.926705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124b56d-d8eb-4817-8c3f-f7097e1c67d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:07.926984 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124b56d-d8eb-4817-8c3f-f7097e1c67d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:07.936240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124b56d-d8eb-4817-8c3f-f7097e1c67d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:07.937667 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124b56d-d8eb-4817-8c3f-f7097e1c67d1 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:07.947237 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 766/1533] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:11.672395 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f07fa-b031-49be-8159-4eb7bcda2f75 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:11.673216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f07fa-b031-49be-8159-4eb7bcda2f75 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:11.673367 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f07fa-b031-49be-8159-4eb7bcda2f75 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:11.675337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:12:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:12:11.680741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf38e4-f8ab-4bba-9e27-fe1f4ffde42e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:11.681190 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf38e4-f8ab-4bba-9e27-fe1f4ffde42e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:11.681295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf38e4-f8ab-4bba-9e27-fe1f4ffde42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:11.700077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-7fdf38e4-f8ab-4bba-9e27-fe1f4ffde42e None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:11.701256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7fdf38e4-f8ab-4bba-9e27-fe1f4ffde42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:11.709871 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:11.985234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f07fa-b031-49be-8159-4eb7bcda2f75 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:11.988556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-ff2f07fa-b031-49be-8159-4eb7bcda2f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:12.057972 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f07fa-b031-49be-8159-4eb7bcda2f75 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:12.062148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba407ac1-ed73-4a54-9c27-280ba6bfd929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49e5814865044696a7d0021d44629604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:12.062824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba407ac1-ed73-4a54-9c27-280ba6bfd929 service cinder] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:12.063108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba407ac1-ed73-4a54-9c27-280ba6bfd929 service cinder] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:12.063390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba407ac1-ed73-4a54-9c27-280ba6bfd929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:12.073117 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba407ac1-ed73-4a54-9c27-280ba6bfd929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:12.074599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba407ac1-ed73-4a54-9c27-280ba6bfd929 service cinder] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:12.084140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 769/1536] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:14.306845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243b57d-2f21-411d-9561-55aaa1f735a7 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:14.307752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243b57d-2f21-411d-9561-55aaa1f735a7 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:14.307901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243b57d-2f21-411d-9561-55aaa1f735a7 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:14.310137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:12:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:12:14.316482 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e987a-68c2-46ec-941d-958266cad4f7 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:14.316928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e987a-68c2-46ec-941d-958266cad4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:14.317052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e987a-68c2-46ec-941d-958266cad4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:14.345975 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-e59e987a-68c2-46ec-941d-958266cad4f7 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:14.347264 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-e59e987a-68c2-46ec-941d-958266cad4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:14.355287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:14.628550 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243b57d-2f21-411d-9561-55aaa1f735a7 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:14.631859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5243b57d-2f21-411d-9561-55aaa1f735a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:14.651748 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243b57d-2f21-411d-9561-55aaa1f735a7 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:14.656633 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35847e64-ea4d-4fb9-b1d2-6bd332d0d165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49e5814865044696a7d0021d44629604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:14.657284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35847e64-ea4d-4fb9-b1d2-6bd332d0d165 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:14.657571 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35847e64-ea4d-4fb9-b1d2-6bd332d0d165 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:14.657848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35847e64-ea4d-4fb9-b1d2-6bd332d0d165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:14.668191 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35847e64-ea4d-4fb9-b1d2-6bd332d0d165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:14.669630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35847e64-ea4d-4fb9-b1d2-6bd332d0d165 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:14.679456 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 769/1539] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:24.337278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=32 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:24.675338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=14 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:39.183180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf380-fa5b-4e43-998c-dd75790d4801 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.183880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf380-fa5b-4e43-998c-dd75790d4801 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.183880 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf380-fa5b-4e43-998c-dd75790d4801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.186398 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0089-eedf-4578-b330-ad0164d81c25 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.186842 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0089-eedf-4578-b330-ad0164d81c25 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.186948 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0089-eedf-4578-b330-ad0164d81c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.203797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-a5cdf380-fa5b-4e43-998c-dd75790d4801 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:39.205015 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-a5cdf380-fa5b-4e43-998c-dd75790d4801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:39.205154 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2cdb0089-eedf-4578-b330-ad0164d81c25 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:39.206253 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2cdb0089-eedf-4578-b330-ad0164d81c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:39.214235 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 771/1540] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:39.219800 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 770/1541] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:39.223522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c87943-df35-40a8-9fb9-47fdb8cd18b4 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.223849 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c87943-df35-40a8-9fb9-47fdb8cd18b4 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.224148 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c87943-df35-40a8-9fb9-47fdb8cd18b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.224278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565af67-aeb0-4d95-a4a3-1cdc54cb93be None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.224574 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565af67-aeb0-4d95-a4a3-1cdc54cb93be None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.224856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565af67-aeb0-4d95-a4a3-1cdc54cb93be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.243098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-66c87943-df35-40a8-9fb9-47fdb8cd18b4 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:39.244346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-66c87943-df35-40a8-9fb9-47fdb8cd18b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:39.244495 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-5565af67-aeb0-4d95-a4a3-1cdc54cb93be None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:39.245613 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-5565af67-aeb0-4d95-a4a3-1cdc54cb93be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:39.252498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 772/1542] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:39.253407 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 771/1543] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:39.256936 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c87943-df35-40a8-9fb9-47fdb8cd18b4 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.257612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565af67-aeb0-4d95-a4a3-1cdc54cb93be None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.266079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c87943-df35-40a8-9fb9-47fdb8cd18b4 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.266504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565af67-aeb0-4d95-a4a3-1cdc54cb93be None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.270595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fce55-3159-46a1-9f18-11ebea54664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.270927 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b00ffe-f2f7-4613-b9dc-d857d3f775dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.271240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fce55-3159-46a1-9f18-11ebea54664c admin admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.271529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fce55-3159-46a1-9f18-11ebea54664c admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.271664 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b00ffe-f2f7-4613-b9dc-d857d3f775dc admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.271836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fce55-3159-46a1-9f18-11ebea54664c admin admin] PATH_INFO: `/v3/domains` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.272012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b00ffe-f2f7-4613-b9dc-d857d3f775dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.272276 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b00ffe-f2f7-4613-b9dc-d857d3f775dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.272580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fce55-3159-46a1-9f18-11ebea54664c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80325) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:13:39.272894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fce55-3159-46a1-9f18-11ebea54664c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.273007 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b00ffe-f2f7-4613-b9dc-d857d3f775dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80326) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:13:39.273308 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b00ffe-f2f7-4613-b9dc-d857d3f775dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.274326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-19b00ffe-f2f7-4613-b9dc-d857d3f775dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:13:39.274326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: warnings.warn(msg) May 25 15:13:39.274326 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: May 25 15:13:39.274606 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fce55-3159-46a1-9f18-11ebea54664c admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.275184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b00ffe-f2f7-4613-b9dc-d857d3f775dc admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.286208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 773/1544] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 15:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:13:39.287180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 772/1545] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 15:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:13:39.294570 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fce55-3159-46a1-9f18-11ebea54664c admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.294809 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b00ffe-f2f7-4613-b9dc-d857d3f775dc admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.304981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b00ffe-f2f7-4613-b9dc-d857d3f775dc admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.305196 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fce55-3159-46a1-9f18-11ebea54664c admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.310990 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a92d1-4049-44ad-831a-c9a0a76f0026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.311679 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a92d1-4049-44ad-831a-c9a0a76f0026 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.311853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8a356-5aaa-477c-b72f-6e3fbe1085f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.311989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a92d1-4049-44ad-831a-c9a0a76f0026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.312390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a92d1-4049-44ad-831a-c9a0a76f0026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.312547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8a356-5aaa-477c-b72f-6e3fbe1085f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.312943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8a356-5aaa-477c-b72f-6e3fbe1085f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.313202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a92d1-4049-44ad-831a-c9a0a76f0026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.313338 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8a356-5aaa-477c-b72f-6e3fbe1085f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.314010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8a356-5aaa-477c-b72f-6e3fbe1085f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.315247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: WARNING py.warnings [None req-25f8a356-5aaa-477c-b72f-6e3fbe1085f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:13:39.315247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: warnings.warn(msg) May 25 15:13:39.315247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: May 25 15:13:39.315535 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a92d1-4049-44ad-831a-c9a0a76f0026 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.316651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8a356-5aaa-477c-b72f-6e3fbe1085f6 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.347753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 773/1546] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:13:39.347961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 774/1547] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:39.349321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8a356-5aaa-477c-b72f-6e3fbe1085f6 admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.349500 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a92d1-4049-44ad-831a-c9a0a76f0026 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.410374 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8a356-5aaa-477c-b72f-6e3fbe1085f6 admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.410638 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a92d1-4049-44ad-831a-c9a0a76f0026 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.415186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07055260-f0ae-4574-b897-06bb32ebc961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.415331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8997c25-8b8c-4828-862e-522dbe7dd9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.415896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997c25-8b8c-4828-862e-522dbe7dd9ad admin admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.416025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07055260-f0ae-4574-b897-06bb32ebc961 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.416203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07055260-f0ae-4574-b897-06bb32ebc961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.416353 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997c25-8b8c-4828-862e-522dbe7dd9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.416476 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997c25-8b8c-4828-862e-522dbe7dd9ad admin admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.416569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07055260-f0ae-4574-b897-06bb32ebc961 admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.417161 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07055260-f0ae-4574-b897-06bb32ebc961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.417295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8997c25-8b8c-4828-862e-522dbe7dd9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.418173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-07055260-f0ae-4574-b897-06bb32ebc961 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:13:39.418173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: warnings.warn(msg) May 25 15:13:39.418173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: May 25 15:13:39.419195 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8997c25-8b8c-4828-862e-522dbe7dd9ad admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.419493 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07055260-f0ae-4574-b897-06bb32ebc961 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.444312 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 774/1549] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:13:39.444547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 775/1549] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:13:39.445322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07055260-f0ae-4574-b897-06bb32ebc961 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.445577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8997c25-8b8c-4828-862e-522dbe7dd9ad admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.455951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8997c25-8b8c-4828-862e-522dbe7dd9ad admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.456750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07055260-f0ae-4574-b897-06bb32ebc961 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.460779 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad87309-b2d2-4395-9f00-bc905b05d2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.461450 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad87309-b2d2-4395-9f00-bc905b05d2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.461814 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad87309-b2d2-4395-9f00-bc905b05d2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.461987 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad87309-b2d2-4395-9f00-bc905b05d2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.462596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920eb5d-2602-4173-ae7d-a27b5e8a3c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.462760 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad87309-b2d2-4395-9f00-bc905b05d2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.463523 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920eb5d-2602-4173-ae7d-a27b5e8a3c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.463925 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920eb5d-2602-4173-ae7d-a27b5e8a3c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.464301 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920eb5d-2602-4173-ae7d-a27b5e8a3c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.464421 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad87309-b2d2-4395-9f00-bc905b05d2c6 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.465263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920eb5d-2602-4173-ae7d-a27b5e8a3c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.466997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920eb5d-2602-4173-ae7d-a27b5e8a3c58 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.474696 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 776/1550] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 15:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:39.480321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 775/1551] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 15:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:13:39.480488 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad87309-b2d2-4395-9f00-bc905b05d2c6 admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.481216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920eb5d-2602-4173-ae7d-a27b5e8a3c58 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.488579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad87309-b2d2-4395-9f00-bc905b05d2c6 admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.490639 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920eb5d-2602-4173-ae7d-a27b5e8a3c58 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.493256 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43f661-2af0-44ea-9350-58e01bd899fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.493914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43f661-2af0-44ea-9350-58e01bd899fd admin admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.494200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43f661-2af0-44ea-9350-58e01bd899fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.494501 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43f661-2af0-44ea-9350-58e01bd899fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.495246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98d25-1fac-4c79-b3a0-fe742e56fbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.495386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43f661-2af0-44ea-9350-58e01bd899fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.495926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98d25-1fac-4c79-b3a0-fe742e56fbcc admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.496212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98d25-1fac-4c79-b3a0-fe742e56fbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.496492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98d25-1fac-4c79-b3a0-fe742e56fbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.496901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43f661-2af0-44ea-9350-58e01bd899fd admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.497259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98d25-1fac-4c79-b3a0-fe742e56fbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.499116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98d25-1fac-4c79-b3a0-fe742e56fbcc admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.507385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 777/1552] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 15:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:13:39.509221 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 776/1553] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 15:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:13:39.511403 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43f661-2af0-44ea-9350-58e01bd899fd admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.513086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98d25-1fac-4c79-b3a0-fe742e56fbcc admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.521732 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43f661-2af0-44ea-9350-58e01bd899fd admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.522863 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98d25-1fac-4c79-b3a0-fe742e56fbcc admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.526519 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049616bf-24c7-40cf-bf2b-0f548f67f761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.527372 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d888bd-9091-4fa2-a50b-dd10cf778f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.527661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049616bf-24c7-40cf-bf2b-0f548f67f761 admin admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.528045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049616bf-24c7-40cf-bf2b-0f548f67f761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.528285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d888bd-9091-4fa2-a50b-dd10cf778f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.528517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049616bf-24c7-40cf-bf2b-0f548f67f761 admin admin] PATH_INFO: `/v3/projects/c72bc671eff8472a9dc4d4e9bc8fe98e/users/e0c2cf1203444b3d8eb366d24d0bc7f2/roles/88c41930377947b7a1dc0134ba0f787b` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.528626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d888bd-9091-4fa2-a50b-dd10cf778f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.528867 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d888bd-9091-4fa2-a50b-dd10cf778f3d admin admin] PATH_INFO: `/v3/projects/63dbb4ec69674ca5a658d73fbbf22ee5/users/097c63456b3c4b339e8689a258541a2b/roles/88c41930377947b7a1dc0134ba0f787b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.543788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d888bd-9091-4fa2-a50b-dd10cf778f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63dbb4ec69674ca5a658d73fbbf22ee5, user_id=097c63456b3c4b339e8689a258541a2b, role_id=88c41930377947b7a1dc0134ba0f787b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.545295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049616bf-24c7-40cf-bf2b-0f548f67f761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72bc671eff8472a9dc4d4e9bc8fe98e, user_id=e0c2cf1203444b3d8eb366d24d0bc7f2, role_id=88c41930377947b7a1dc0134ba0f787b)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.546370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: WARNING py.warnings [None req-049616bf-24c7-40cf-bf2b-0f548f67f761 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:13:39.546370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: warnings.warn(msg) May 25 15:13:39.546370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: May 25 15:13:39.546647 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d888bd-9091-4fa2-a50b-dd10cf778f3d admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.548624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049616bf-24c7-40cf-bf2b-0f548f67f761 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.560719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 777/1554] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 15:13:39 2022] PUT /identity/v3/projects/63dbb4ec69674ca5a658d73fbbf22ee5/users/097c63456b3c4b339e8689a258541a2b/roles/88c41930377947b7a1dc0134ba0f787b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:13:39.562562 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 778/1555] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 15:13:39 2022] PUT /identity/v3/projects/c72bc671eff8472a9dc4d4e9bc8fe98e/users/e0c2cf1203444b3d8eb366d24d0bc7f2/roles/88c41930377947b7a1dc0134ba0f787b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:13:39.565788 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf2139-b6cf-4596-b092-94a28bde47bf None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.566079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf2139-b6cf-4596-b092-94a28bde47bf None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.566393 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf2139-b6cf-4596-b092-94a28bde47bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.567830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217066e-2f77-40e7-88d8-7457949a21d9 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.568129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217066e-2f77-40e7-88d8-7457949a21d9 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.568406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217066e-2f77-40e7-88d8-7457949a21d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.583385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-dacf2139-b6cf-4596-b092-94a28bde47bf None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:39.584618 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-4217066e-2f77-40e7-88d8-7457949a21d9 None None] MFA Rules not processed for user `ad3666eef9be46b0b4707636932d0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:39.584739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-dacf2139-b6cf-4596-b092-94a28bde47bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:39.585929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-4217066e-2f77-40e7-88d8-7457949a21d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:39.633131 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:39.634033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:39.646847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 778/1556] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:39.650105 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 779/1557] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:13:39.656818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf2139-b6cf-4596-b092-94a28bde47bf None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.657000 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217066e-2f77-40e7-88d8-7457949a21d9 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:39.711259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf2139-b6cf-4596-b092-94a28bde47bf None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.712406 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217066e-2f77-40e7-88d8-7457949a21d9 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:39.715135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3aa0ba-b6ed-48b6-91fe-d4709f0f3e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.715438 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aa0ba-b6ed-48b6-91fe-d4709f0f3e82 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.715782 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aa0ba-b6ed-48b6-91fe-d4709f0f3e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.716111 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce28a2-2230-4c7a-824c-80a529066987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:39.716302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3aa0ba-b6ed-48b6-91fe-d4709f0f3e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.716749 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce28a2-2230-4c7a-824c-80a529066987 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:39.717008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce28a2-2230-4c7a-824c-80a529066987 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:39.717285 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce28a2-2230-4c7a-824c-80a529066987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:39.725767 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3aa0ba-b6ed-48b6-91fe-d4709f0f3e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.726634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce28a2-2230-4c7a-824c-80a529066987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:39.727134 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3aa0ba-b6ed-48b6-91fe-d4709f0f3e82 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.728114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce28a2-2230-4c7a-824c-80a529066987 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:39.737050 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 779/1558] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:13:39.737466 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 780/1559] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:13:44.447013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466b8d-dcf9-4a72-8c66-db0f760d4c77 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:44.447537 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466b8d-dcf9-4a72-8c66-db0f760d4c77 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:44.447869 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466b8d-dcf9-4a72-8c66-db0f760d4c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:44.501697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-95466b8d-dcf9-4a72-8c66-db0f760d4c77 None None] MFA Rules not processed for user `e0c2cf1203444b3d8eb366d24d0bc7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:44.502933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-95466b8d-dcf9-4a72-8c66-db0f760d4c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:44.608564 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 780/1560] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:13:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:44.613329 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce28a2-2230-4c7a-824c-80a529066987 service neutron] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:44.630245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce28a2-2230-4c7a-824c-80a529066987 service neutron] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:44.635950 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42b7bb-9c98-41b0-9cc3-fcc72644d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:44.637369 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42b7bb-9c98-41b0-9cc3-fcc72644d231 admin admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:44.637845 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42b7bb-9c98-41b0-9cc3-fcc72644d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:44.638339 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42b7bb-9c98-41b0-9cc3-fcc72644d231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:44.640162 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42b7bb-9c98-41b0-9cc3-fcc72644d231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:44.642951 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42b7bb-9c98-41b0-9cc3-fcc72644d231 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:44.677832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 781/1561] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 15:13:44 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:13:44.681775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95466b8d-dcf9-4a72-8c66-db0f760d4c77 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:44.698241 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95466b8d-dcf9-4a72-8c66-db0f760d4c77 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:44.794739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2081c-b03d-4547-ad50-03cd69e0994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:44.796455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2081c-b03d-4547-ad50-03cd69e0994f admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:44.796640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2081c-b03d-4547-ad50-03cd69e0994f admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:44.797384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2081c-b03d-4547-ad50-03cd69e0994f admin admin] PATH_INFO: `/v3/users` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:44.798206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2081c-b03d-4547-ad50-03cd69e0994f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:44.801785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2081c-b03d-4547-ad50-03cd69e0994f admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:44.828785 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 781/1562] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 15:13:44 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:44.832584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42b7bb-9c98-41b0-9cc3-fcc72644d231 admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:44.852555 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42b7bb-9c98-41b0-9cc3-fcc72644d231 admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:44.865195 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b529-1184-47ae-9c94-91bcbf7a6f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:44.865855 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b529-1184-47ae-9c94-91bcbf7a6f4d admin admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:44.866296 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b529-1184-47ae-9c94-91bcbf7a6f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:44.866599 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b529-1184-47ae-9c94-91bcbf7a6f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:44.867622 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1b529-1184-47ae-9c94-91bcbf7a6f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:44.870371 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1b529-1184-47ae-9c94-91bcbf7a6f4d admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:44.896122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 782/1563] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 15:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:44.900803 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2081c-b03d-4547-ad50-03cd69e0994f admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:44.914933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2081c-b03d-4547-ad50-03cd69e0994f admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:44.922098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14ccdf-838d-4298-bf4f-beee67edd6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:44.923035 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14ccdf-838d-4298-bf4f-beee67edd6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:44.923323 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14ccdf-838d-4298-bf4f-beee67edd6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:44.923660 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14ccdf-838d-4298-bf4f-beee67edd6c5 admin admin] PATH_INFO: `/v3/projects/bd195c64add340218a81ef1fbd77ea1e/users/38407b99ca194629975a42318fb487ad/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:44.950267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14ccdf-838d-4298-bf4f-beee67edd6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd195c64add340218a81ef1fbd77ea1e, user_id=38407b99ca194629975a42318fb487ad, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:44.953548 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14ccdf-838d-4298-bf4f-beee67edd6c5 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:44.957129 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:45.009941 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 782/1564] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 15:13:44 2022] PUT /identity/v3/projects/bd195c64add340218a81ef1fbd77ea1e/users/38407b99ca194629975a42318fb487ad/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:45.015222 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b529-1184-47ae-9c94-91bcbf7a6f4d admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:45.030818 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b529-1184-47ae-9c94-91bcbf7a6f4d admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:45.142018 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b11042-a060-4a72-8c36-cdf6a2c1db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:45.142720 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11042-a060-4a72-8c36-cdf6a2c1db9b admin admin] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:45.143027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11042-a060-4a72-8c36-cdf6a2c1db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:45.143287 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11042-a060-4a72-8c36-cdf6a2c1db9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:45.144065 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b11042-a060-4a72-8c36-cdf6a2c1db9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:45.145861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b11042-a060-4a72-8c36-cdf6a2c1db9b admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:45.160376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 783/1565] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 15:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:45.164202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14ccdf-838d-4298-bf4f-beee67edd6c5 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:45.183027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14ccdf-838d-4298-bf4f-beee67edd6c5 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:45.189926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadaf36-0842-40bc-9fda-08b367e839c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:45.190755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadaf36-0842-40bc-9fda-08b367e839c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:45.191040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadaf36-0842-40bc-9fda-08b367e839c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:45.191318 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadaf36-0842-40bc-9fda-08b367e839c1 admin admin] PATH_INFO: `/v3/projects/bd195c64add340218a81ef1fbd77ea1e/users/38407b99ca194629975a42318fb487ad/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:45.196134 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadaf36-0842-40bc-9fda-08b367e839c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd195c64add340218a81ef1fbd77ea1e, user_id=38407b99ca194629975a42318fb487ad, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:45.201029 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadaf36-0842-40bc-9fda-08b367e839c1 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:45.238928 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 783/1566] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 15:13:45 2022] PUT /identity/v3/projects/bd195c64add340218a81ef1fbd77ea1e/users/38407b99ca194629975a42318fb487ad/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:45.795804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec143ea-aa97-4d89-b78b-776e63c8d7c2 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:45.796864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec143ea-aa97-4d89-b78b-776e63c8d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:45.797356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec143ea-aa97-4d89-b78b-776e63c8d7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:45.848394 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-0ec143ea-aa97-4d89-b78b-776e63c8d7c2 None None] MFA Rules not processed for user `097c63456b3c4b339e8689a258541a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:45.850057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-0ec143ea-aa97-4d89-b78b-776e63c8d7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:45.969240 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:46.020187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 784/1567] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:13:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:46.024697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadaf36-0842-40bc-9fda-08b367e839c1 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:46.127428 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadaf36-0842-40bc-9fda-08b367e839c1 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:46.140025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39dc87-ad7d-4103-be00-1a07fe86ebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:46.141332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39dc87-ad7d-4103-be00-1a07fe86ebf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:46.141332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39dc87-ad7d-4103-be00-1a07fe86ebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:46.141540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39dc87-ad7d-4103-be00-1a07fe86ebf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:46.143042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39dc87-ad7d-4103-be00-1a07fe86ebf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:46.145736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39dc87-ad7d-4103-be00-1a07fe86ebf7 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:46.216033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 784/1568] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 15:13:46 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:46.218624 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec143ea-aa97-4d89-b78b-776e63c8d7c2 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:46.237186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec143ea-aa97-4d89-b78b-776e63c8d7c2 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:46.354498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9db4f-1836-46e0-9a61-c4ed338d3440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:46.355508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9db4f-1836-46e0-9a61-c4ed338d3440 admin admin] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:46.357040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9db4f-1836-46e0-9a61-c4ed338d3440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:46.357620 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9db4f-1836-46e0-9a61-c4ed338d3440 admin admin] PATH_INFO: `/v3/users` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:46.359991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9db4f-1836-46e0-9a61-c4ed338d3440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:46.362929 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9db4f-1836-46e0-9a61-c4ed338d3440 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:46.400136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 785/1569] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 15:13:46 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:13:46.403454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39dc87-ad7d-4103-be00-1a07fe86ebf7 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:46.418075 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39dc87-ad7d-4103-be00-1a07fe86ebf7 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:46.423939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec42b2-9f0a-4bc8-982b-c2e7edaeda63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:46.424705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec42b2-9f0a-4bc8-982b-c2e7edaeda63 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:46.424933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec42b2-9f0a-4bc8-982b-c2e7edaeda63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:46.425220 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec42b2-9f0a-4bc8-982b-c2e7edaeda63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:46.425983 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec42b2-9f0a-4bc8-982b-c2e7edaeda63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:46.427786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec42b2-9f0a-4bc8-982b-c2e7edaeda63 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:46.440814 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 785/1570] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 15:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:13:46.445013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9db4f-1836-46e0-9a61-c4ed338d3440 admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:46.458078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9db4f-1836-46e0-9a61-c4ed338d3440 admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:46.464122 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f367586-e551-4612-a92d-88496c52aad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:46.465178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f367586-e551-4612-a92d-88496c52aad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:46.465384 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f367586-e551-4612-a92d-88496c52aad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:46.465753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f367586-e551-4612-a92d-88496c52aad9 admin admin] PATH_INFO: `/v3/projects/38100e4769b14b98925f5e4f0d95c2c2/users/d5ae5c8fc4be47d8b052c92ff4687698/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:46.484578 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f367586-e551-4612-a92d-88496c52aad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38100e4769b14b98925f5e4f0d95c2c2, user_id=d5ae5c8fc4be47d8b052c92ff4687698, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:46.488031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f367586-e551-4612-a92d-88496c52aad9 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:46.533939 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 786/1571] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 15:13:46 2022] PUT /identity/v3/projects/38100e4769b14b98925f5e4f0d95c2c2/users/d5ae5c8fc4be47d8b052c92ff4687698/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:46.535297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec42b2-9f0a-4bc8-982b-c2e7edaeda63 admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:46.547324 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec42b2-9f0a-4bc8-982b-c2e7edaeda63 admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:46.619992 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20db48-16c6-4712-96a6-e9ab8c1b4bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:46.620848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20db48-16c6-4712-96a6-e9ab8c1b4bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:46.623093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20db48-16c6-4712-96a6-e9ab8c1b4bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:46.623508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20db48-16c6-4712-96a6-e9ab8c1b4bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:46.627649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20db48-16c6-4712-96a6-e9ab8c1b4bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:46.630064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20db48-16c6-4712-96a6-e9ab8c1b4bf1 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:46.652068 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 786/1572] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 15:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:13:46.656663 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f367586-e551-4612-a92d-88496c52aad9 admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:46.669955 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f367586-e551-4612-a92d-88496c52aad9 admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:46.676432 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd30495-451b-400b-9eb3-f67d727392de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:46.678641 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd30495-451b-400b-9eb3-f67d727392de admin admin] REQUEST_METHOD: `PUT` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:46.678985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd30495-451b-400b-9eb3-f67d727392de admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:46.679270 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd30495-451b-400b-9eb3-f67d727392de admin admin] PATH_INFO: `/v3/projects/38100e4769b14b98925f5e4f0d95c2c2/users/d5ae5c8fc4be47d8b052c92ff4687698/roles/6d2f768dab8e41468cfb393a0ed80766` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:46.682061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd30495-451b-400b-9eb3-f67d727392de admin admin] RBAC: Authorizing `identity:create_grant(project_id=38100e4769b14b98925f5e4f0d95c2c2, user_id=d5ae5c8fc4be47d8b052c92ff4687698, role_id=6d2f768dab8e41468cfb393a0ed80766)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:46.685180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd30495-451b-400b-9eb3-f67d727392de admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:46.704147 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 787/1573] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 15:13:46 2022] PUT /identity/v3/projects/38100e4769b14b98925f5e4f0d95c2c2/users/d5ae5c8fc4be47d8b052c92ff4687698/roles/6d2f768dab8e41468cfb393a0ed80766 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:13:52.568459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf502-3854-4add-940b-a922acc5d824 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.568965 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf502-3854-4add-940b-a922acc5d824 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.569216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf502-3854-4add-940b-a922acc5d824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.607861 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-01acf502-3854-4add-940b-a922acc5d824 None None] MFA Rules not processed for user `38407b99ca194629975a42318fb487ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:52.609252 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-01acf502-3854-4add-940b-a922acc5d824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:52.666915 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:52.764149 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 787/1574] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:52.786770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd30495-451b-400b-9eb3-f67d727392de admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:52.787840 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-cbd30495-451b-400b-9eb3-f67d727392de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:52.882995 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd30495-451b-400b-9eb3-f67d727392de admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:52.886899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd28d91-c2a0-4d82-bcb2-7632fc0e8a61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f0aa2ddbcb494f8a5a53399793aa2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:52.887699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd28d91-c2a0-4d82-bcb2-7632fc0e8a61 service glance] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.888007 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd28d91-c2a0-4d82-bcb2-7632fc0e8a61 service glance] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.888455 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd28d91-c2a0-4d82-bcb2-7632fc0e8a61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.965557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd28d91-c2a0-4d82-bcb2-7632fc0e8a61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:52.967197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd28d91-c2a0-4d82-bcb2-7632fc0e8a61 service glance] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:52.975132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:52.981446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 788/1575] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:13:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:53.434846 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbde0f-afcc-4d2b-9ceb-8d83eaf3eddc None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.435229 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbde0f-afcc-4d2b-9ceb-8d83eaf3eddc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.435418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbde0f-afcc-4d2b-9ceb-8d83eaf3eddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.495449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-b5cbde0f-afcc-4d2b-9ceb-8d83eaf3eddc None None] MFA Rules not processed for user `d5ae5c8fc4be47d8b052c92ff4687698`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:53.496906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-b5cbde0f-afcc-4d2b-9ceb-8d83eaf3eddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:53.650193 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 788/1576] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:13:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:53.658528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd28d91-c2a0-4d82-bcb2-7632fc0e8a61 service glance] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:53.676098 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd28d91-c2a0-4d82-bcb2-7632fc0e8a61 service glance] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:53.680797 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f40bdd-bca5-4ac9-a8ae-5e9fd466582e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f0aa2ddbcb494f8a5a53399793aa2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:53.681479 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f40bdd-bca5-4ac9-a8ae-5e9fd466582e service glance] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:53.681769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f40bdd-bca5-4ac9-a8ae-5e9fd466582e service glance] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:53.682556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f40bdd-bca5-4ac9-a8ae-5e9fd466582e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:53.821273 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f40bdd-bca5-4ac9-a8ae-5e9fd466582e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:53.822820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f40bdd-bca5-4ac9-a8ae-5e9fd466582e service glance] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:53.848180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 789/1577] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:13:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:54.118612 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1e8b0-5308-4258-abfb-731d0aec822b None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:54.118888 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1e8b0-5308-4258-abfb-731d0aec822b None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:54.119343 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1e8b0-5308-4258-abfb-731d0aec822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:54.150747 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-2db1e8b0-5308-4258-abfb-731d0aec822b None None] MFA Rules not processed for user `042393fa408b45208021befccd6bd800`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:54.152292 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2db1e8b0-5308-4258-abfb-731d0aec822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:54.304955 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 789/1578] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 15:13:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:54.487465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f40bdd-bca5-4ac9-a8ae-5e9fd466582e service glance] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:54.489051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-d7f40bdd-bca5-4ac9-a8ae-5e9fd466582e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:54.610628 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f40bdd-bca5-4ac9-a8ae-5e9fd466582e service glance] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:54.621858 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d70919-017f-4f1d-ba82-1ef56ac77a6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1643cf33cd3b417bb2cd15b5503f7ffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:54.622644 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d70919-017f-4f1d-ba82-1ef56ac77a6a service swift] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:54.622937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d70919-017f-4f1d-ba82-1ef56ac77a6a service swift] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:54.623214 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d70919-017f-4f1d-ba82-1ef56ac77a6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:54.652595 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d70919-017f-4f1d-ba82-1ef56ac77a6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:54.654296 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d70919-017f-4f1d-ba82-1ef56ac77a6a service swift] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:54.663533 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 790/1579] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 15:13:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:13:54.945683 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e646b3c-72b2-4434-809a-42b12a65c7e4 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:54.946590 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e646b3c-72b2-4434-809a-42b12a65c7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:54.947066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e646b3c-72b2-4434-809a-42b12a65c7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:54.983611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-3e646b3c-72b2-4434-809a-42b12a65c7e4 None None] MFA Rules not processed for user `042393fa408b45208021befccd6bd800`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:54.994826 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-3e646b3c-72b2-4434-809a-42b12a65c7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:55.005277 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 790/1580] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 15:13:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:55.032132 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d70919-017f-4f1d-ba82-1ef56ac77a6a service swift] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:55.046553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d70919-017f-4f1d-ba82-1ef56ac77a6a service swift] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:55.053864 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d0ef3-f6ad-4502-ba24-eef531008171 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1643cf33cd3b417bb2cd15b5503f7ffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:55.054580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0ef3-f6ad-4502-ba24-eef531008171 service swift] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:55.054870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0ef3-f6ad-4502-ba24-eef531008171 service swift] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:55.055150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d0ef3-f6ad-4502-ba24-eef531008171 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:55.064860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d0ef3-f6ad-4502-ba24-eef531008171 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:55.067140 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d0ef3-f6ad-4502-ba24-eef531008171 service swift] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:55.076386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 791/1581] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 15:13:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:14:04.807587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f905-de25-447e-9422-f2a6b2ac2f8d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:04.808255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f905-de25-447e-9422-f2a6b2ac2f8d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:04.808255 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f905-de25-447e-9422-f2a6b2ac2f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:04.826556 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-db73f905-de25-447e-9422-f2a6b2ac2f8d None None] MFA Rules not processed for user `097c63456b3c4b339e8689a258541a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:04.827808 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-db73f905-de25-447e-9422-f2a6b2ac2f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:04.835436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 791/1582] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:14:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:05.072605 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=67 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:05.124143 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa22b4-1870-494b-8e6e-8e3c052e0441 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:05.125034 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa22b4-1870-494b-8e6e-8e3c052e0441 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:05.125496 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa22b4-1870-494b-8e6e-8e3c052e0441 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:05.128487 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 792/1583] 10.222.0.24 () {54 vars in 961 bytes} [Wed May 25 15:14:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:14:05.132707 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac3bde-726e-40ee-bb12-667ada539361 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:05.133002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac3bde-726e-40ee-bb12-667ada539361 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:05.133288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac3bde-726e-40ee-bb12-667ada539361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:05.154617 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-49ac3bde-726e-40ee-bb12-667ada539361 None None] MFA Rules not processed for user `f553cee02ab345dabbef807bfe85544a`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:05.156114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-49ac3bde-726e-40ee-bb12-667ada539361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:05.219602 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=100 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:05.239451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 792/1584] 10.222.0.24 () {58 vars in 1058 bytes} [Wed May 25 15:14:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:05.245226 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c1f5-9bc6-4408-923f-897cdf418f48 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:05.245516 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c1f5-9bc6-4408-923f-897cdf418f48 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:05.245798 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c1f5-9bc6-4408-923f-897cdf418f48 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:05.247263 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 793/1585] 10.222.0.24 () {54 vars in 912 bytes} [Wed May 25 15:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:14:05.253891 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b35f4-ba7b-4606-895e-24712effb115 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:05.254189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b35f4-ba7b-4606-895e-24712effb115 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:05.254472 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b35f4-ba7b-4606-895e-24712effb115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:05.272874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-8e3b35f4-ba7b-4606-895e-24712effb115 None None] MFA Rules not processed for user `f553cee02ab345dabbef807bfe85544a`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:05.274136 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-8e3b35f4-ba7b-4606-895e-24712effb115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:05.286164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 793/1586] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 15:14:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:05.298380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c1f5-9bc6-4408-923f-897cdf418f48 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:05.300368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-ad11c1f5-9bc6-4408-923f-897cdf418f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:05.314834 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c1f5-9bc6-4408-923f-897cdf418f48 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:05.319314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224cafa-16fe-4827-aec8-a958982b9198 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f0aa2ddbcb494f8a5a53399793aa2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:05.320020 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224cafa-16fe-4827-aec8-a958982b9198 service glance] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:05.320309 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224cafa-16fe-4827-aec8-a958982b9198 service glance] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:05.320584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224cafa-16fe-4827-aec8-a958982b9198 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:05.332514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224cafa-16fe-4827-aec8-a958982b9198 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:05.333971 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224cafa-16fe-4827-aec8-a958982b9198 service glance] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:05.346066 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 794/1587] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:14:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:14:05.709743 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291e67f-4e73-4c66-9c41-815a88c68c6e None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:05.710351 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291e67f-4e73-4c66-9c41-815a88c68c6e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:05.710852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291e67f-4e73-4c66-9c41-815a88c68c6e None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:05.712313 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 794/1588] 10.222.0.24 () {54 vars in 912 bytes} [Wed May 25 15:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:14:05.718278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf1618-70b0-4303-9f02-22f9e3a5987b None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:05.718572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf1618-70b0-4303-9f02-22f9e3a5987b None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:05.718856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf1618-70b0-4303-9f02-22f9e3a5987b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:05.755302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-b8cf1618-70b0-4303-9f02-22f9e3a5987b None None] MFA Rules not processed for user `d4b24eb13be7443f9c24e55532ef95d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:05.756558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-b8cf1618-70b0-4303-9f02-22f9e3a5987b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:05.810178 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 795/1589] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 15:14:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:05.824874 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291e67f-4e73-4c66-9c41-815a88c68c6e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:05.838215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291e67f-4e73-4c66-9c41-815a88c68c6e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:05.843440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64bf78-1f88-4828-8ca7-df8da6cc8841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:05.844130 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64bf78-1f88-4828-8ca7-df8da6cc8841 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:05.844402 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64bf78-1f88-4828-8ca7-df8da6cc8841 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:05.844686 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64bf78-1f88-4828-8ca7-df8da6cc8841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:05.853251 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64bf78-1f88-4828-8ca7-df8da6cc8841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:05.854699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64bf78-1f88-4828-8ca7-df8da6cc8841 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:05.863089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 795/1590] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:14:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:14:06.268604 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1f1fa-392c-4006-ab4e-23068a569391 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:06.269697 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1f1fa-392c-4006-ab4e-23068a569391 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:06.269981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1f1fa-392c-4006-ab4e-23068a569391 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:06.272308 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 796/1591] 10.222.0.24 () {54 vars in 961 bytes} [Wed May 25 15:14:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:14:06.285554 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40753556-bd39-47df-b3eb-71c39df5f877 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:06.285854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40753556-bd39-47df-b3eb-71c39df5f877 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:06.286146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40753556-bd39-47df-b3eb-71c39df5f877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:06.305350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-40753556-bd39-47df-b3eb-71c39df5f877 None None] MFA Rules not processed for user `f553cee02ab345dabbef807bfe85544a`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:06.306836 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-40753556-bd39-47df-b3eb-71c39df5f877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:06.315107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1c3c1-2216-4517-a4c1-fe8fd4bc16ae None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:06.315397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1c3c1-2216-4517-a4c1-fe8fd4bc16ae None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:06.315718 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1c3c1-2216-4517-a4c1-fe8fd4bc16ae None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:06.317397 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 797/1592] 10.222.0.24 () {54 vars in 960 bytes} [Wed May 25 15:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:14:06.320931 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 796/1593] 10.222.0.24 () {58 vars in 1058 bytes} [Wed May 25 15:14:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:06.322410 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83334b0-edcf-4827-a624-433d86d9d8af None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:06.322709 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83334b0-edcf-4827-a624-433d86d9d8af None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:06.322991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83334b0-edcf-4827-a624-433d86d9d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:06.326288 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e9c7-5c14-4119-852c-5cc51fcf64bb None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:06.326719 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e9c7-5c14-4119-852c-5cc51fcf64bb None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:06.326958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e9c7-5c14-4119-852c-5cc51fcf64bb None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:06.328322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 797/1594] 10.222.0.24 () {54 vars in 912 bytes} [Wed May 25 15:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:14:06.334839 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab3402-c08a-4da8-92e4-0d4c2ae96c4e None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:06.335170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab3402-c08a-4da8-92e4-0d4c2ae96c4e None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:06.335416 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab3402-c08a-4da8-92e4-0d4c2ae96c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:06.346543 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-e83334b0-edcf-4827-a624-433d86d9d8af None None] MFA Rules not processed for user `3b717fe1f83743eabe4be630ddbe508c`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:06.347917 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-e83334b0-edcf-4827-a624-433d86d9d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:06.354812 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c8ab3402-c08a-4da8-92e4-0d4c2ae96c4e None None] MFA Rules not processed for user `f553cee02ab345dabbef807bfe85544a`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:06.356206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c8ab3402-c08a-4da8-92e4-0d4c2ae96c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:06.365576 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 798/1595] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 15:14:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:06.377577 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab3402-c08a-4da8-92e4-0d4c2ae96c4e None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:06.386736 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab3402-c08a-4da8-92e4-0d4c2ae96c4e None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:06.390578 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7740f1-bace-4ef6-bb2c-852e96e4f024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:06.391205 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7740f1-bace-4ef6-bb2c-852e96e4f024 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:06.391487 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7740f1-bace-4ef6-bb2c-852e96e4f024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:06.391792 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7740f1-bace-4ef6-bb2c-852e96e4f024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:06.407443 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7740f1-bace-4ef6-bb2c-852e96e4f024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:06.408926 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7740f1-bace-4ef6-bb2c-852e96e4f024 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:06.410957 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 798/1596] 10.222.0.24 () {58 vars in 1057 bytes} [Wed May 25 15:14:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:06.418959 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83334b0-edcf-4827-a624-433d86d9d8af None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:06.420774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 799/1597] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:14:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:14:06.433824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83334b0-edcf-4827-a624-433d86d9d8af None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:06.440234 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b18350-0462-4da2-93fb-a1fbfc4f594e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b717fe1f83743eabe4be630ddbe508c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:06.440903 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b18350-0462-4da2-93fb-a1fbfc4f594e service placement] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:06.441186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b18350-0462-4da2-93fb-a1fbfc4f594e service placement] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:06.441774 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b18350-0462-4da2-93fb-a1fbfc4f594e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:06.443579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-04b18350-0462-4da2-93fb-a1fbfc4f594e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:06.455761 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b18350-0462-4da2-93fb-a1fbfc4f594e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:06.457390 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b18350-0462-4da2-93fb-a1fbfc4f594e service placement] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:06.467086 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 799/1598] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:14:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:08.318120 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbbc0f-f4cc-4cfc-805e-07b9b0e95a6d None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:08.318662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbbc0f-f4cc-4cfc-805e-07b9b0e95a6d None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:08.319503 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbbc0f-f4cc-4cfc-805e-07b9b0e95a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:08.346389 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-c9dbbc0f-f4cc-4cfc-805e-07b9b0e95a6d None None] MFA Rules not processed for user `042393fa408b45208021befccd6bd800`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:08.347744 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c9dbbc0f-f4cc-4cfc-805e-07b9b0e95a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:08.355780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 800/1599] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 15:14:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:08.370133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b18350-0462-4da2-93fb-a1fbfc4f594e service placement] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:08.381453 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b18350-0462-4da2-93fb-a1fbfc4f594e service placement] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:08.387302 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aab529-906b-484d-bd17-ffb0b68dd449 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1643cf33cd3b417bb2cd15b5503f7ffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:08.387980 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aab529-906b-484d-bd17-ffb0b68dd449 service swift] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:08.388269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aab529-906b-484d-bd17-ffb0b68dd449 service swift] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:08.388547 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aab529-906b-484d-bd17-ffb0b68dd449 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:08.396999 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aab529-906b-484d-bd17-ffb0b68dd449 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:08.398594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aab529-906b-484d-bd17-ffb0b68dd449 service swift] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:08.411597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 800/1600] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 15:14:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:14:16.477592 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ecbc0-d5eb-4646-af01-59330e3d3d11 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:16.478114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ecbc0-d5eb-4646-af01-59330e3d3d11 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:16.478114 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ecbc0-d5eb-4646-af01-59330e3d3d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:16.497789 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-4c7ecbc0-d5eb-4646-af01-59330e3d3d11 None None] MFA Rules not processed for user `d4b24eb13be7443f9c24e55532ef95d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:16.498961 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-4c7ecbc0-d5eb-4646-af01-59330e3d3d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:16.506702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 801/1601] 10.222.0.45 () {58 vars in 1015 bytes} [Wed May 25 15:14:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:16.523546 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aab529-906b-484d-bd17-ffb0b68dd449 service swift] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:16.534682 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aab529-906b-484d-bd17-ffb0b68dd449 service swift] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:16.538852 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81a4e-7e88-4d03-8a8d-3a10c6be84ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:16.539488 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81a4e-7e88-4d03-8a8d-3a10c6be84ae service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:16.539802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81a4e-7e88-4d03-8a8d-3a10c6be84ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:16.540063 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81a4e-7e88-4d03-8a8d-3a10c6be84ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:16.547424 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f81a4e-7e88-4d03-8a8d-3a10c6be84ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:16.549260 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f81a4e-7e88-4d03-8a8d-3a10c6be84ae service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:16.558278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 801/1602] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:14:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:17.340558 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996b18-39cf-401c-9ed0-193ba284a3c1 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:17.341024 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996b18-39cf-401c-9ed0-193ba284a3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:17.341669 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996b18-39cf-401c-9ed0-193ba284a3c1 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:17.343127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 802/1603] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 15:14:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:14:17.378391 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548179d-179b-4dfe-abe6-e3d15c53bd41 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:17.378691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548179d-179b-4dfe-abe6-e3d15c53bd41 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:17.378978 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548179d-179b-4dfe-abe6-e3d15c53bd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:17.399821 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-9548179d-179b-4dfe-abe6-e3d15c53bd41 None None] MFA Rules not processed for user `f553cee02ab345dabbef807bfe85544a`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:17.404555 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-9548179d-179b-4dfe-abe6-e3d15c53bd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:17.415997 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 802/1604] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 15:14:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:17.569280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae996b18-39cf-401c-9ed0-193ba284a3c1 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:17.586062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae996b18-39cf-401c-9ed0-193ba284a3c1 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:17.592043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a666b-02c7-44f3-9372-a8b14375dc52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:17.592704 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a666b-02c7-44f3-9372-a8b14375dc52 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:17.592989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a666b-02c7-44f3-9372-a8b14375dc52 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:17.593268 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a666b-02c7-44f3-9372-a8b14375dc52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:17.603245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a666b-02c7-44f3-9372-a8b14375dc52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:17.604981 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a666b-02c7-44f3-9372-a8b14375dc52 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:17.616170 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 803/1605] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:14:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:24.724569 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8d3e-0e64-4a1c-8d42-9e061186c91a None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:24.725165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8d3e-0e64-4a1c-8d42-9e061186c91a None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:24.725165 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8d3e-0e64-4a1c-8d42-9e061186c91a None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:24.726509 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 803/1606] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 15:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:14:24.735418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fcccf-834d-4b8c-a4fe-761c9b7dbec9 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:24.736033 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fcccf-834d-4b8c-a4fe-761c9b7dbec9 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:24.736297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fcccf-834d-4b8c-a4fe-761c9b7dbec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:24.759108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-6f3fcccf-834d-4b8c-a4fe-761c9b7dbec9 None None] MFA Rules not processed for user `f553cee02ab345dabbef807bfe85544a`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:24.760672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-6f3fcccf-834d-4b8c-a4fe-761c9b7dbec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:24.770991 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 804/1607] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 15:14:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:24.783658 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8d3e-0e64-4a1c-8d42-9e061186c91a None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:24.807327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8d3e-0e64-4a1c-8d42-9e061186c91a None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:24.813017 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f348ca-f433-4629-b5a0-74f80838782e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:24.813810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f348ca-f433-4629-b5a0-74f80838782e service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:24.814095 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f348ca-f433-4629-b5a0-74f80838782e service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:24.814368 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f348ca-f433-4629-b5a0-74f80838782e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:24.824321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f348ca-f433-4629-b5a0-74f80838782e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:24.825914 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f348ca-f433-4629-b5a0-74f80838782e service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:24.836464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 804/1608] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:14:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:14:34.752811 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=43 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:34.832702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=91 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:39.867002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fcccf-834d-4b8c-a4fe-761c9b7dbec9 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:39.877802 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fcccf-834d-4b8c-a4fe-761c9b7dbec9 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:39.882750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637e549-f71c-4db7-85dc-619ea54ffddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:39.883436 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e549-f71c-4db7-85dc-619ea54ffddd service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:39.883754 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e549-f71c-4db7-85dc-619ea54ffddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:39.884030 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e549-f71c-4db7-85dc-619ea54ffddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:39.893758 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637e549-f71c-4db7-85dc-619ea54ffddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:39.895199 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637e549-f71c-4db7-85dc-619ea54ffddd service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:39.904765 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 805/1609] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:14:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:48.768399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f8c01-3419-443f-8f32-04c43d48aee3 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:48.768954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f8c01-3419-443f-8f32-04c43d48aee3 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:48.768954 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f8c01-3419-443f-8f32-04c43d48aee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:48.786557 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-672f8c01-3419-443f-8f32-04c43d48aee3 None None] MFA Rules not processed for user `e0c2cf1203444b3d8eb366d24d0bc7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:48.787810 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-672f8c01-3419-443f-8f32-04c43d48aee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:48.795413 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 805/1610] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:14:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:49.900433 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:58.781532 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=3 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:31.677208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e319f-6c78-48af-a4b1-7450d6b64039 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:31.677764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e319f-6c78-48af-a4b1-7450d6b64039 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:31.677764 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e319f-6c78-48af-a4b1-7450d6b64039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:31.700001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-210e319f-6c78-48af-a4b1-7450d6b64039 None None] MFA Rules not processed for user `e0c2cf1203444b3d8eb366d24d0bc7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:31.701828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-210e319f-6c78-48af-a4b1-7450d6b64039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:31.714750 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 806/1611] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:15:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:32.204854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3ea16-2d0a-49fe-96a9-f259159ed881 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:32.205409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3ea16-2d0a-49fe-96a9-f259159ed881 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:32.205409 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3ea16-2d0a-49fe-96a9-f259159ed881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:32.225007 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-b6f3ea16-2d0a-49fe-96a9-f259159ed881 None None] MFA Rules not processed for user `d4b24eb13be7443f9c24e55532ef95d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:32.226204 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-b6f3ea16-2d0a-49fe-96a9-f259159ed881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:32.234153 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 806/1612] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 15:15:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:32.248173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e319f-6c78-48af-a4b1-7450d6b64039 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:32.259528 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e319f-6c78-48af-a4b1-7450d6b64039 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:32.264783 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3651ead-d3f6-423d-b78c-b1a7faaa304a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:32.265448 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3651ead-d3f6-423d-b78c-b1a7faaa304a service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:32.265737 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3651ead-d3f6-423d-b78c-b1a7faaa304a service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:32.266010 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3651ead-d3f6-423d-b78c-b1a7faaa304a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:32.274969 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3651ead-d3f6-423d-b78c-b1a7faaa304a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:32.277213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3651ead-d3f6-423d-b78c-b1a7faaa304a service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:32.290011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 807/1613] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:15:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:15:42.219597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=3 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:42.285150 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=9 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:48.156189 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c5c04-b8bc-468a-b0d4-1a8b5607c4be None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:48.156677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c5c04-b8bc-468a-b0d4-1a8b5607c4be None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:48.156770 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c5c04-b8bc-468a-b0d4-1a8b5607c4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:48.174446 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-376c5c04-b8bc-468a-b0d4-1a8b5607c4be None None] MFA Rules not processed for user `042393fa408b45208021befccd6bd800`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:48.175672 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-376c5c04-b8bc-468a-b0d4-1a8b5607c4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:48.183360 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 807/1614] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 15:15:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:48.223579 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3651ead-d3f6-423d-b78c-b1a7faaa304a service neutron] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:48.236804 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3651ead-d3f6-423d-b78c-b1a7faaa304a service neutron] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:48.242452 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd401ee-42e9-4a83-9b6c-3a7c3c879d03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1643cf33cd3b417bb2cd15b5503f7ffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:48.243102 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd401ee-42e9-4a83-9b6c-3a7c3c879d03 service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:48.243398 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd401ee-42e9-4a83-9b6c-3a7c3c879d03 service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:48.243717 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd401ee-42e9-4a83-9b6c-3a7c3c879d03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:48.252459 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd401ee-42e9-4a83-9b6c-3a7c3c879d03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:48.254054 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd401ee-42e9-4a83-9b6c-3a7c3c879d03 service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:48.262169 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 808/1615] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 15:15:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:15:51.604321 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90958d5-144b-4468-af6a-3bc7b04409d3 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:51.604930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90958d5-144b-4468-af6a-3bc7b04409d3 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:51.605023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90958d5-144b-4468-af6a-3bc7b04409d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:51.624079 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-b90958d5-144b-4468-af6a-3bc7b04409d3 None None] MFA Rules not processed for user `e0c2cf1203444b3d8eb366d24d0bc7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:51.625267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-b90958d5-144b-4468-af6a-3bc7b04409d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:51.632673 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 808/1616] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:15:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:58.259331 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:01.618362 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=6 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:13.466475 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22055c-a9ac-495a-85b2-5e60bee6f300 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:13.467031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22055c-a9ac-495a-85b2-5e60bee6f300 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:13.467031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22055c-a9ac-495a-85b2-5e60bee6f300 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:13.468498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 809/1617] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 15:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:16:13.475248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efbed4-7977-4a51-936d-c5465afc2c26 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:13.476289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efbed4-7977-4a51-936d-c5465afc2c26 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:13.476752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efbed4-7977-4a51-936d-c5465afc2c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:13.516753 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-88efbed4-7977-4a51-936d-c5465afc2c26 None None] MFA Rules not processed for user `f553cee02ab345dabbef807bfe85544a`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:13.518008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-88efbed4-7977-4a51-936d-c5465afc2c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:13.573243 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 809/1618] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 15:16:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:16:13.585649 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22055c-a9ac-495a-85b2-5e60bee6f300 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:13.600107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22055c-a9ac-495a-85b2-5e60bee6f300 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:13.606057 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047d0a1-861e-4954-9967-8f84c631d414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:13.606734 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047d0a1-861e-4954-9967-8f84c631d414 service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:13.607026 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047d0a1-861e-4954-9967-8f84c631d414 service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:13.607365 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047d0a1-861e-4954-9967-8f84c631d414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:13.616772 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047d0a1-861e-4954-9967-8f84c631d414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:13.618358 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047d0a1-861e-4954-9967-8f84c631d414 service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:13.629005 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 810/1619] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:16:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:19.364534 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559e088-e519-428b-942d-40c1a7ab18fb None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:19.365065 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559e088-e519-428b-942d-40c1a7ab18fb None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:19.365202 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559e088-e519-428b-942d-40c1a7ab18fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:19.384245 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-b559e088-e519-428b-942d-40c1a7ab18fb None None] MFA Rules not processed for user `042393fa408b45208021befccd6bd800`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:19.385492 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-b559e088-e519-428b-942d-40c1a7ab18fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:19.392854 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 810/1620] 10.222.0.24 () {58 vars in 967 bytes} [Wed May 25 15:16:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:16:19.410820 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047d0a1-861e-4954-9967-8f84c631d414 service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:19.423431 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047d0a1-861e-4954-9967-8f84c631d414 service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:19.429336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc84414-d72d-4d7e-bb3a-057544acb0c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1643cf33cd3b417bb2cd15b5503f7ffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:19.430041 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc84414-d72d-4d7e-bb3a-057544acb0c1 service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:19.430317 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc84414-d72d-4d7e-bb3a-057544acb0c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:19.430575 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc84414-d72d-4d7e-bb3a-057544acb0c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:19.446970 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc84414-d72d-4d7e-bb3a-057544acb0c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:19.449259 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc84414-d72d-4d7e-bb3a-057544acb0c1 service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:19.462151 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 811/1621] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 15:16:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:16:19.509464 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20900b-d2c6-44e1-901a-c0803723eaa6 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:19.509757 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20900b-d2c6-44e1-901a-c0803723eaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:19.510082 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20900b-d2c6-44e1-901a-c0803723eaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:19.529933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-5f20900b-d2c6-44e1-901a-c0803723eaa6 None None] MFA Rules not processed for user `042393fa408b45208021befccd6bd800`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:19.531168 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-5f20900b-d2c6-44e1-901a-c0803723eaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:19.539101 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 811/1622] 10.222.0.24 () {58 vars in 967 bytes} [Wed May 25 15:16:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:16:19.552787 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc84414-d72d-4d7e-bb3a-057544acb0c1 service swift] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:19.563731 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc84414-d72d-4d7e-bb3a-057544acb0c1 service swift] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:19.569077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16262d2-8450-4945-ad9a-5b5d03fbc76a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1643cf33cd3b417bb2cd15b5503f7ffd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:19.569912 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16262d2-8450-4945-ad9a-5b5d03fbc76a service swift] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:19.570163 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16262d2-8450-4945-ad9a-5b5d03fbc76a service swift] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:19.570449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16262d2-8450-4945-ad9a-5b5d03fbc76a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:19.579319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16262d2-8450-4945-ad9a-5b5d03fbc76a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:19.580933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16262d2-8450-4945-ad9a-5b5d03fbc76a service swift] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:19.589452 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 812/1623] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 15:16:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:16:23.440626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a981f3-8304-4dc0-a78e-536f5f46aac6 None None] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:23.441206 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a981f3-8304-4dc0-a78e-536f5f46aac6 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:23.441327 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a981f3-8304-4dc0-a78e-536f5f46aac6 None None] PATH_INFO: `/` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:23.442651 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 812/1624] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 15:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:16:23.449693 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1a29-7f89-41d7-97fc-c41915eff0a3 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:23.450203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1a29-7f89-41d7-97fc-c41915eff0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:23.450280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1a29-7f89-41d7-97fc-c41915eff0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:23.472456 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-157b1a29-7f89-41d7-97fc-c41915eff0a3 None None] MFA Rules not processed for user `3b717fe1f83743eabe4be630ddbe508c`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:23.473827 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-157b1a29-7f89-41d7-97fc-c41915eff0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:23.483186 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 813/1625] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 15:16:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:16:23.494357 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a981f3-8304-4dc0-a78e-536f5f46aac6 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:23.510269 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a981f3-8304-4dc0-a78e-536f5f46aac6 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:23.528593 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce059a7d-1d2d-4e75-9eb1-f460debbd1c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b717fe1f83743eabe4be630ddbe508c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:23.530008 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce059a7d-1d2d-4e75-9eb1-f460debbd1c5 service placement] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:23.530295 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce059a7d-1d2d-4e75-9eb1-f460debbd1c5 service placement] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:23.530572 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce059a7d-1d2d-4e75-9eb1-f460debbd1c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:23.540138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce059a7d-1d2d-4e75-9eb1-f460debbd1c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:23.541894 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce059a7d-1d2d-4e75-9eb1-f460debbd1c5 service placement] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:23.552090 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 813/1626] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:16:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:26.841422 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f5099-533d-4105-93f6-e4ceaa265193 None None] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:26.841943 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f5099-533d-4105-93f6-e4ceaa265193 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:26.842023 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f5099-533d-4105-93f6-e4ceaa265193 None None] PATH_INFO: `/` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:26.843596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 814/1627] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 15:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:16:26.857013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71496415-7a45-4a42-bf5b-12482d099f64 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:26.857529 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71496415-7a45-4a42-bf5b-12482d099f64 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:26.857610 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71496415-7a45-4a42-bf5b-12482d099f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:26.919279 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f5099-533d-4105-93f6-e4ceaa265193 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:26.950062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-71496415-7a45-4a42-bf5b-12482d099f64 None None] MFA Rules not processed for user `3b717fe1f83743eabe4be630ddbe508c`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:26.951303 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-71496415-7a45-4a42-bf5b-12482d099f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:26.969873 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 814/1628] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:16:26.980184 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71496415-7a45-4a42-bf5b-12482d099f64 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:26.992219 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71496415-7a45-4a42-bf5b-12482d099f64 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:26.999298 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc9cb3-a8d8-472f-bd00-2ed7b502af79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b717fe1f83743eabe4be630ddbe508c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:27.000003 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc9cb3-a8d8-472f-bd00-2ed7b502af79 service placement] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:27.000265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc9cb3-a8d8-472f-bd00-2ed7b502af79 service placement] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:27.000540 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc9cb3-a8d8-472f-bd00-2ed7b502af79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:27.009135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc9cb3-a8d8-472f-bd00-2ed7b502af79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:27.010741 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc9cb3-a8d8-472f-bd00-2ed7b502af79 service placement] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:27.020108 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f5099-533d-4105-93f6-e4ceaa265193 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:27.020542 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 815/1629] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:16:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:16:27.024791 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:27.025727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:27.026009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:27.026284 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] PATH_INFO: `/v3/users/097c63456b3c4b339e8689a258541a2b` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:27.027522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] RBAC: Authorizing `identity:delete_user(user_id=097c63456b3c4b339e8689a258541a2b)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:27.029715 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:27.078808 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '097c63456b3c4b339e8689a258541a2b'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.091064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '097c63456b3c4b339e8689a258541a2b'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.091796 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '097c63456b3c4b339e8689a258541a2b'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.100118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '097c63456b3c4b339e8689a258541a2b'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.100739 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '097c63456b3c4b339e8689a258541a2b'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.116780 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 815/1630] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 15:16:26 2022] DELETE /identity/v3/users/097c63456b3c4b339e8689a258541a2b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:16:27.309209 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc9cb3-a8d8-472f-bd00-2ed7b502af79 service placement] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:27.326011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc9cb3-a8d8-472f-bd00-2ed7b502af79 service placement] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:27.388138 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:27.388906 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:27.389187 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:27.389461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] PATH_INFO: `/v3/projects/63dbb4ec69674ca5a658d73fbbf22ee5` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:27.390662 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=63dbb4ec69674ca5a658d73fbbf22ee5)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:27.392625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:27.410001 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=100 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:27.449870 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63dbb4ec69674ca5a658d73fbbf22ee5', 'request_id': 'req-7c63f681-2c86-4204-a1ad-88d392ca6e9f'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.461611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63dbb4ec69674ca5a658d73fbbf22ee5', 'request_id': 'req-7c63f681-2c86-4204-a1ad-88d392ca6e9f'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.468210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63dbb4ec69674ca5a658d73fbbf22ee5', 'request_id': 'req-7c63f681-2c86-4204-a1ad-88d392ca6e9f'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.494144 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] The token cache is being invalidate because project 63dbb4ec69674ca5a658d73fbbf22ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80325) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:16:27.494442 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.495133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.496847 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 816/1631] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 15:16:27 2022] DELETE /identity/v3/projects/63dbb4ec69674ca5a658d73fbbf22ee5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:16:27.501012 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:27.502434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:27.518676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de649bc-9c07-4716-aa02-3deec4d8256c admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:27.537445 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:27.586839 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451de5d2-3b71-4ad4-9e82-5b4c3ba800ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:27.587769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451de5d2-3b71-4ad4-9e82-5b4c3ba800ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:27.588164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451de5d2-3b71-4ad4-9e82-5b4c3ba800ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:27.588451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451de5d2-3b71-4ad4-9e82-5b4c3ba800ea admin admin] PATH_INFO: `/v3/users/d5ae5c8fc4be47d8b052c92ff4687698` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:27.589705 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451de5d2-3b71-4ad4-9e82-5b4c3ba800ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ae5c8fc4be47d8b052c92ff4687698)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:27.591702 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451de5d2-3b71-4ad4-9e82-5b4c3ba800ea admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:27.642938 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-451de5d2-3b71-4ad4-9e82-5b4c3ba800ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ae5c8fc4be47d8b052c92ff4687698'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.655896 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-451de5d2-3b71-4ad4-9e82-5b4c3ba800ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ae5c8fc4be47d8b052c92ff4687698'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.656597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-451de5d2-3b71-4ad4-9e82-5b4c3ba800ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ae5c8fc4be47d8b052c92ff4687698'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.666405 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-451de5d2-3b71-4ad4-9e82-5b4c3ba800ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ae5c8fc4be47d8b052c92ff4687698'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.667266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-451de5d2-3b71-4ad4-9e82-5b4c3ba800ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ae5c8fc4be47d8b052c92ff4687698'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:27.680886 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 816/1632] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 15:16:27 2022] DELETE /identity/v3/users/d5ae5c8fc4be47d8b052c92ff4687698 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:16:27.864314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:27.866561 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:27.880626 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63f681-2c86-4204-a1ad-88d392ca6e9f admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:27.950988 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:27.951901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:27.952181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:27.952454 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] PATH_INFO: `/v3/projects/38100e4769b14b98925f5e4f0d95c2c2` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:27.953677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38100e4769b14b98925f5e4f0d95c2c2)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:27.955611 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:28.003045 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38100e4769b14b98925f5e4f0d95c2c2', 'request_id': 'req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:28.008839 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38100e4769b14b98925f5e4f0d95c2c2', 'request_id': 'req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:28.015346 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38100e4769b14b98925f5e4f0d95c2c2', 'request_id': 'req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:28.031502 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] The token cache is being invalidate because project 38100e4769b14b98925f5e4f0d95c2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80325) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:16:28.031830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:28.032460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:16:28.034052 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 817/1633] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 15:16:27 2022] DELETE /identity/v3/projects/38100e4769b14b98925f5e4f0d95c2c2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:16:35.395675 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb7015-8ece-4e23-834d-b0098724bbc2 None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:35.396207 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb7015-8ece-4e23-834d-b0098724bbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:35.396322 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb7015-8ece-4e23-834d-b0098724bbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:35.417051 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-73fb7015-8ece-4e23-834d-b0098724bbc2 None None] MFA Rules not processed for user `e0c2cf1203444b3d8eb366d24d0bc7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:35.418258 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-73fb7015-8ece-4e23-834d-b0098724bbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:35.480768 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 817/1634] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:16:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:16:38.028210 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=76,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:45.473201 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:52.014819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:52.016506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:52.097362 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76705a-3efc-41e2-83ae-3db5eb5a21b7 admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:52.101203 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa4ee3-f30d-4a1a-8bca-a77c07354071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:52.101907 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa4ee3-f30d-4a1a-8bca-a77c07354071 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:52.102180 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa4ee3-f30d-4a1a-8bca-a77c07354071 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:52.102460 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa4ee3-f30d-4a1a-8bca-a77c07354071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:52.104377 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-30aa4ee3-f30d-4a1a-8bca-a77c07354071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:52.169648 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa4ee3-f30d-4a1a-8bca-a77c07354071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:52.171135 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa4ee3-f30d-4a1a-8bca-a77c07354071 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:52.180853 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 818/1635] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:16:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:58.455216 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb7015-8ece-4e23-834d-b0098724bbc2 None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:58.456930 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-73fb7015-8ece-4e23-834d-b0098724bbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:58.532314 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb7015-8ece-4e23-834d-b0098724bbc2 None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:58.538061 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b5f6b-1288-4ac4-adbf-b4ca356160da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b717fe1f83743eabe4be630ddbe508c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:58.539040 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b5f6b-1288-4ac4-adbf-b4ca356160da service placement] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:58.539473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b5f6b-1288-4ac4-adbf-b4ca356160da service placement] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:58.539985 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b5f6b-1288-4ac4-adbf-b4ca356160da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:58.542035 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c09b5f6b-1288-4ac4-adbf-b4ca356160da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:58.553699 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b5f6b-1288-4ac4-adbf-b4ca356160da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:58.555299 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b5f6b-1288-4ac4-adbf-b4ca356160da service placement] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:58.565689 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 818/1636] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:16:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:17:02.176860 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=59 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:17:08.561208 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=32 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:18:52.176933 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3149-dd12-49ab-9212-5fd9e721d829 None None] REQUEST_METHOD: `POST` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:52.177471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3149-dd12-49ab-9212-5fd9e721d829 None None] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:52.177471 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3149-dd12-49ab-9212-5fd9e721d829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:52.208949 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.auth.core [None req-184f3149-dd12-49ab-9212-5fd9e721d829 None None] MFA Rules not processed for user `e0c2cf1203444b3d8eb366d24d0bc7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80325) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:18:52.210133 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-184f3149-dd12-49ab-9212-5fd9e721d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:52.218215 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 819/1637] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:18:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:18:52.832183 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b5f6b-1288-4ac4-adbf-b4ca356160da service placement] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:52.833722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-c09b5f6b-1288-4ac4-adbf-b4ca356160da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:52.914964 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b5f6b-1288-4ac4-adbf-b4ca356160da service placement] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:52.918901 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2eddc-e029-4115-a5b0-3a8acac89626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49e5814865044696a7d0021d44629604', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:52.919589 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2eddc-e029-4115-a5b0-3a8acac89626 service cinder] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:52.919882 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2eddc-e029-4115-a5b0-3a8acac89626 service cinder] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:52.920143 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2eddc-e029-4115-a5b0-3a8acac89626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:52.922280 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-02d2eddc-e029-4115-a5b0-3a8acac89626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:52.933580 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2eddc-e029-4115-a5b0-3a8acac89626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:52.935025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2eddc-e029-4115-a5b0-3a8acac89626 service cinder] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:52.944514 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 819/1638] 10.222.0.24 () {60 vars in 1396 bytes} [Wed May 25 15:18:52 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:19:02.197070 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=3 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:02.939819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=35 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:04.078013 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3149-dd12-49ab-9212-5fd9e721d829 None None] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:19:04.079848 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-184f3149-dd12-49ab-9212-5fd9e721d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:19:04.093336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3149-dd12-49ab-9212-5fd9e721d829 None None] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:19:04.097379 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7d03c-e7b1-4c9b-ba16-44a572b926f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:19:04.098028 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7d03c-e7b1-4c9b-ba16-44a572b926f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:19:04.098311 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7d03c-e7b1-4c9b-ba16-44a572b926f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:19:04.098584 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7d03c-e7b1-4c9b-ba16-44a572b926f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:19:04.100478 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-82b7d03c-e7b1-4c9b-ba16-44a572b926f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:19:04.193794 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7d03c-e7b1-4c9b-ba16-44a572b926f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:19:04.195254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7d03c-e7b1-4c9b-ba16-44a572b926f1 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:19:04.216832 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 820/1639] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:19:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:19:05.409265 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2eddc-e029-4115-a5b0-3a8acac89626 service cinder] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:19:05.422011 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2eddc-e029-4115-a5b0-3a8acac89626 service cinder] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:19:05.426677 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd7553-f314-48ad-a93a-050767f353f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:19:05.427337 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd7553-f314-48ad-a93a-050767f353f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:19:05.427661 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd7553-f314-48ad-a93a-050767f353f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:19:05.427946 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd7553-f314-48ad-a93a-050767f353f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:19:05.430197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-2bdd7553-f314-48ad-a93a-050767f353f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:19:05.445775 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd7553-f314-48ad-a93a-050767f353f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:19:05.447274 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd7553-f314-48ad-a93a-050767f353f8 service neutron] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:19:05.458634 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 820/1640] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:19:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:19:14.214089 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=46 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:15.454332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:20:01.137042 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7d03c-e7b1-4c9b-ba16-44a572b926f1 service neutron] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:20:01.148828 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7d03c-e7b1-4c9b-ba16-44a572b926f1 service neutron] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:20:01.153643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb9fce-e59c-40ac-82a9-90ed587e2957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:20:01.154336 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb9fce-e59c-40ac-82a9-90ed587e2957 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:01.154625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb9fce-e59c-40ac-82a9-90ed587e2957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:01.154899 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb9fce-e59c-40ac-82a9-90ed587e2957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:01.157116 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-2ffb9fce-e59c-40ac-82a9-90ed587e2957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:01.167173 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb9fce-e59c-40ac-82a9-90ed587e2957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:20:01.168656 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb9fce-e59c-40ac-82a9-90ed587e2957 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:20:01.177078 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 821/1641] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:20:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:20:11.173640 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=6 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:20:43.197058 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3507b3c-dd07-41aa-acc3-1ed40fbacecc None None] REQUEST_METHOD: `POST` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:43.197654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3507b3c-dd07-41aa-acc3-1ed40fbacecc None None] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:43.197654 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3507b3c-dd07-41aa-acc3-1ed40fbacecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:43.218233 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.auth.core [None req-e3507b3c-dd07-41aa-acc3-1ed40fbacecc None None] MFA Rules not processed for user `e0c2cf1203444b3d8eb366d24d0bc7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80326) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:20:43.219418 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e3507b3c-dd07-41aa-acc3-1ed40fbacecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:43.227837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 821/1642] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 15:20:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:20:43.580597 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb9fce-e59c-40ac-82a9-90ed587e2957 service neutron] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:20:43.594194 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb9fce-e59c-40ac-82a9-90ed587e2957 service neutron] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:20:43.598629 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d03df0-1387-4848-9618-1bf5b7a8e252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:20:43.599272 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d03df0-1387-4848-9618-1bf5b7a8e252 service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:43.599527 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d03df0-1387-4848-9618-1bf5b7a8e252 service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:43.599830 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d03df0-1387-4848-9618-1bf5b7a8e252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:43.601831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-a6d03df0-1387-4848-9618-1bf5b7a8e252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:43.611077 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d03df0-1387-4848-9618-1bf5b7a8e252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:20:43.612596 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d03df0-1387-4848-9618-1bf5b7a8e252 service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:20:43.620399 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 822/1643] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:20:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:20:44.111271 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3507b3c-dd07-41aa-acc3-1ed40fbacecc None None] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:20:44.112881 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-e3507b3c-dd07-41aa-acc3-1ed40fbacecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:44.130043 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3507b3c-dd07-41aa-acc3-1ed40fbacecc None None] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:20:44.135898 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5bd21-1f87-4a4a-abf9-cd8e77ec6dfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b717fe1f83743eabe4be630ddbe508c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:20:44.136887 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5bd21-1f87-4a4a-abf9-cd8e77ec6dfa service placement] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:44.137137 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5bd21-1f87-4a4a-abf9-cd8e77ec6dfa service placement] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:44.137434 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5bd21-1f87-4a4a-abf9-cd8e77ec6dfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:44.139508 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cbc5bd21-1f87-4a4a-abf9-cd8e77ec6dfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:44.153181 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5bd21-1f87-4a4a-abf9-cd8e77ec6dfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:20:44.154979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5bd21-1f87-4a4a-abf9-cd8e77ec6dfa service placement] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:20:44.166504 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 822/1644] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:20:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:20:46.849119 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d03df0-1387-4848-9618-1bf5b7a8e252 service neutron] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:20:46.851553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-a6d03df0-1387-4848-9618-1bf5b7a8e252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:46.869381 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d03df0-1387-4848-9618-1bf5b7a8e252 service neutron] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:20:46.882286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc297b-5140-4e14-82d7-fc72b569fc57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:20:46.883505 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc297b-5140-4e14-82d7-fc72b569fc57 service nova] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:46.884025 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc297b-5140-4e14-82d7-fc72b569fc57 service nova] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:46.884289 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc297b-5140-4e14-82d7-fc72b569fc57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:46.886937 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-b4bc297b-5140-4e14-82d7-fc72b569fc57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:46.901565 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc297b-5140-4e14-82d7-fc72b569fc57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:20:46.903247 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc297b-5140-4e14-82d7-fc72b569fc57 service nova] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:20:46.915212 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 823/1645] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:20:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:20:54.161722 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=9 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:20:56.910064 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=12 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:20:56.953944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5bd21-1f87-4a4a-abf9-cd8e77ec6dfa service placement] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:20:56.955452 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-cbc5bd21-1f87-4a4a-abf9-cd8e77ec6dfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:56.971176 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5bd21-1f87-4a4a-abf9-cd8e77ec6dfa service placement] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:20:56.977945 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6499d9-2f6d-448a-9e1b-cb15803cad9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:20:56.978587 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6499d9-2f6d-448a-9e1b-cb15803cad9d service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:56.979020 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6499d9-2f6d-448a-9e1b-cb15803cad9d service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:56.979439 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6499d9-2f6d-448a-9e1b-cb15803cad9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:56.981449 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-7d6499d9-2f6d-448a-9e1b-cb15803cad9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:56.994182 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6499d9-2f6d-448a-9e1b-cb15803cad9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:20:56.995875 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6499d9-2f6d-448a-9e1b-cb15803cad9d service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:20:57.006506 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 823/1646] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:20:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:21:07.002335 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:02.416278 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc297b-5140-4e14-82d7-fc72b569fc57 service nova] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:02.428465 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc297b-5140-4e14-82d7-fc72b569fc57 service nova] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:02.435143 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c49d1b-ae2c-42d0-a1ad-12c2bb54b108 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b717fe1f83743eabe4be630ddbe508c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:02.435831 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c49d1b-ae2c-42d0-a1ad-12c2bb54b108 service placement] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:02.436118 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c49d1b-ae2c-42d0-a1ad-12c2bb54b108 service placement] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:02.436400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c49d1b-ae2c-42d0-a1ad-12c2bb54b108 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:02.446473 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c49d1b-ae2c-42d0-a1ad-12c2bb54b108 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:02.448145 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c49d1b-ae2c-42d0-a1ad-12c2bb54b108 service placement] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:02.458615 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 824/1647] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:22:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:22:12.454363 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=6 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:32.835146 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6499d9-2f6d-448a-9e1b-cb15803cad9d service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:32.848541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6499d9-2f6d-448a-9e1b-cb15803cad9d service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:32.855376 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951148da-f827-47f8-8778-a33a952026ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f553cee02ab345dabbef807bfe85544a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:32.856062 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951148da-f827-47f8-8778-a33a952026ff service nova] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:32.856350 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951148da-f827-47f8-8778-a33a952026ff service nova] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:32.856725 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951148da-f827-47f8-8778-a33a952026ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:32.858518 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-951148da-f827-47f8-8778-a33a952026ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:32.871517 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951148da-f827-47f8-8778-a33a952026ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:32.873109 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951148da-f827-47f8-8778-a33a952026ff service nova] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:32.884228 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 824/1648] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:22:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:22:42.879962 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=6 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:43.139071 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c49d1b-ae2c-42d0-a1ad-12c2bb54b108 service placement] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:43.149197 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c49d1b-ae2c-42d0-a1ad-12c2bb54b108 service placement] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:43.153859 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c54a3-89e4-4856-9d1e-2451829bd8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4b24eb13be7443f9c24e55532ef95d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:43.154497 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c54a3-89e4-4856-9d1e-2451829bd8df service neutron] REQUEST_METHOD: `GET` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:43.154781 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c54a3-89e4-4856-9d1e-2451829bd8df service neutron] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:43.155060 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c54a3-89e4-4856-9d1e-2451829bd8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:43.157213 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-f32c54a3-89e4-4856-9d1e-2451829bd8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:43.223332 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c54a3-89e4-4856-9d1e-2451829bd8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:43.224824 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c54a3-89e4-4856-9d1e-2451829bd8df service neutron] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:43.234149 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 825/1649] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:22:46.302856 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951148da-f827-47f8-8778-a33a952026ff service nova] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:46.314451 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951148da-f827-47f8-8778-a33a952026ff service nova] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:46.319769 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c1103-02cf-4166-8cc4-b3f74b759c02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b717fe1f83743eabe4be630ddbe508c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ad2e4552f43f09ebf85b6c82a5481', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:46.320440 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c1103-02cf-4166-8cc4-b3f74b759c02 service placement] REQUEST_METHOD: `GET` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:46.320724 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c1103-02cf-4166-8cc4-b3f74b759c02 service placement] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:46.321002 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c1103-02cf-4166-8cc4-b3f74b759c02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:46.323380 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-ea8c1103-02cf-4166-8cc4-b3f74b759c02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:46.335400 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c1103-02cf-4166-8cc4-b3f74b759c02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:46.337107 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c1103-02cf-4166-8cc4-b3f74b759c02 service placement] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:46.348248 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 825/1650] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 15:22:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:22:49.601755 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c54a3-89e4-4856-9d1e-2451829bd8df service neutron] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:49.603310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-f32c54a3-89e4-4856-9d1e-2451829bd8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:49.616461 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c54a3-89e4-4856-9d1e-2451829bd8df service neutron] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:49.621676 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:49.622575 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:49.622905 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:49.623200 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] PATH_INFO: `/v3/users/e0c2cf1203444b3d8eb366d24d0bc7f2` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:49.624621 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c2cf1203444b3d8eb366d24d0bc7f2)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:49.625727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: WARNING py.warnings [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:22:49.625727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: warnings.warn(msg) May 25 15:22:49.625727 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: May 25 15:22:49.627009 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:49.692643 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c2cf1203444b3d8eb366d24d0bc7f2'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:49.711094 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c2cf1203444b3d8eb366d24d0bc7f2'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:49.719746 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c2cf1203444b3d8eb366d24d0bc7f2'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:49.720362 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c2cf1203444b3d8eb366d24d0bc7f2'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:49.730254 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c2cf1203444b3d8eb366d24d0bc7f2'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:49.736625 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 826/1651] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 15:22:49 2022] DELETE /identity/v3/users/e0c2cf1203444b3d8eb366d24d0bc7f2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:22:49.916267 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c1103-02cf-4166-8cc4-b3f74b759c02 service placement] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:49.926762 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c1103-02cf-4166-8cc4-b3f74b759c02 service placement] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:49.994944 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:49.996127 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:49.996427 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:49.996740 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] PATH_INFO: `/v3/projects/c72bc671eff8472a9dc4d4e9bc8fe98e` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:49.998799 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72bc671eff8472a9dc4d4e9bc8fe98e)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:50.000386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: WARNING py.warnings [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:22:50.000386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: warnings.warn(msg) May 25 15:22:50.000386 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: May 25 15:22:50.001645 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:50.062498 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72bc671eff8472a9dc4d4e9bc8fe98e', 'request_id': 'req-56adc249-1aec-4aa1-9e61-ed21c94842da'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.069325 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72bc671eff8472a9dc4d4e9bc8fe98e', 'request_id': 'req-56adc249-1aec-4aa1-9e61-ed21c94842da'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.079966 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72bc671eff8472a9dc4d4e9bc8fe98e', 'request_id': 'req-56adc249-1aec-4aa1-9e61-ed21c94842da'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.100745 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] The token cache is being invalidate because project c72bc671eff8472a9dc4d4e9bc8fe98e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:22:50.101031 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.101691 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.103356 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 826/1652] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 15:22:49 2022] DELETE /identity/v3/projects/c72bc671eff8472a9dc4d4e9bc8fe98e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:22:50.107808 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] Authenticating user token {{(pid=80325) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:50.109370 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.fernet_utils [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80325) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:50.122819 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebc16c-4889-425f-b025-239882c79129 admin admin] Validating token access rules against request {{(pid=80325) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:50.184032 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125a992-1578-415e-adb2-9bc9ba4cae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80325) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:50.184956 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a992-1578-415e-adb2-9bc9ba4cae87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:50.185246 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a992-1578-415e-adb2-9bc9ba4cae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:50.185524 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a992-1578-415e-adb2-9bc9ba4cae87 admin admin] PATH_INFO: `/v3/users/38407b99ca194629975a42318fb487ad` {{(pid=80325) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:50.186752 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125a992-1578-415e-adb2-9bc9ba4cae87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38407b99ca194629975a42318fb487ad)` {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:50.188786 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125a992-1578-415e-adb2-9bc9ba4cae87 admin admin] RBAC: Authorization granted {{(pid=80325) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:50.194249 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:50.240653 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-f125a992-1578-415e-adb2-9bc9ba4cae87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38407b99ca194629975a42318fb487ad'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.252286 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-f125a992-1578-415e-adb2-9bc9ba4cae87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38407b99ca194629975a42318fb487ad'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.260777 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-f125a992-1578-415e-adb2-9bc9ba4cae87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38407b99ca194629975a42318fb487ad'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.261541 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-f125a992-1578-415e-adb2-9bc9ba4cae87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38407b99ca194629975a42318fb487ad'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.268989 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG keystone.notifications [None req-f125a992-1578-415e-adb2-9bc9ba4cae87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38407b99ca194629975a42318fb487ad'} {{(pid=80325) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.275115 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: [pid: 80325|app: 0|req: 827/1653] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 15:22:50 2022] DELETE /identity/v3/users/38407b99ca194629975a42318fb487ad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:22:50.464328 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] Authenticating user token {{(pid=80326) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:50.465837 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.fernet_utils [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80326) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:50.478297 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adc249-1aec-4aa1-9e61-ed21c94842da admin admin] Validating token access rules against request {{(pid=80326) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:50.539385 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83e356-bef9-45c5-a477-58f409f1adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad3666eef9be46b0b4707636932d0a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e02961c51b473ebdfc8f91d292091e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80326) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:50.540310 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83e356-bef9-45c5-a477-58f409f1adc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:50.540594 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83e356-bef9-45c5-a477-58f409f1adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:50.540875 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83e356-bef9-45c5-a477-58f409f1adc9 admin admin] PATH_INFO: `/v3/projects/bd195c64add340218a81ef1fbd77ea1e` {{(pid=80326) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:50.542093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83e356-bef9-45c5-a477-58f409f1adc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd195c64add340218a81ef1fbd77ea1e)` {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:50.544093 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83e356-bef9-45c5-a477-58f409f1adc9 admin admin] RBAC: Authorization granted {{(pid=80326) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:50.565164 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:50.593630 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0d83e356-bef9-45c5-a477-58f409f1adc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd195c64add340218a81ef1fbd77ea1e', 'request_id': 'req-0d83e356-bef9-45c5-a477-58f409f1adc9'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.599412 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0d83e356-bef9-45c5-a477-58f409f1adc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd195c64add340218a81ef1fbd77ea1e', 'request_id': 'req-0d83e356-bef9-45c5-a477-58f409f1adc9'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.607522 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0d83e356-bef9-45c5-a477-58f409f1adc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd195c64add340218a81ef1fbd77ea1e', 'request_id': 'req-0d83e356-bef9-45c5-a477-58f409f1adc9'} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.619027 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0d83e356-bef9-45c5-a477-58f409f1adc9 admin admin] The token cache is being invalidate because project bd195c64add340218a81ef1fbd77ea1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80326) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:22:50.619319 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0d83e356-bef9-45c5-a477-58f409f1adc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.619958 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG keystone.notifications [None req-0d83e356-bef9-45c5-a477-58f409f1adc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80326) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:22:50.621553 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: [pid: 80326|app: 0|req: 827/1654] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 15:22:50 2022] DELETE /identity/v3/projects/bd195c64add340218a81ef1fbd77ea1e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:23:00.271979 dv-osbrick-830800-16-iscsi devstack@keystone.service[80325]: DEBUG dbcounter [-] [80325] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80325) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:23:00.616266 dv-osbrick-830800-16-iscsi devstack@keystone.service[80326]: DEBUG dbcounter [-] [80326] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}